Re:Show HN: Factorio Learning Environment – Agents Build Fac...
by grayhatter on Tuesday March 11, 2025 @12:19PM
(#43334032)
> As the complexity of the game state grew and the screenshots were filled with more entities, the models got even more confused and started hallucinating directions, entities etc or weren't capable of troubleshooting factories with apparent mistakes (i.e missing transport belt, wrongly rotated inserter). We think it's because [...]
I think you just described a research paper that would advance sota. Less describing why, but how. (Assuming it's not just, wy finetuned the model and it worked perfectly)
Re:Show HN: Factorio Learning Environment – Agents Build Fac...
by martbakler on Tuesday March 11, 2025 @01:19PM
(#43334820)
Sounds almost like a visual "needle in a haystack" type of work, that could be quite interesting!
Re:Show HN: Factorio Learning Environment – Agents Build Fac...
by pyinstallwoes on Tuesday March 11, 2025 @08:18PM
(#43338600)
Where’s Waldo test for vlm
Re:Show HN: Factorio Learning Environment – Agents Build Fac...
by vessenes on Tuesday March 11, 2025 @11:39AM
(#43333560)
That makes sense and it’s really interesting - it is a challenging visual test for sure; thousands of entities, either multi tier visual representations (screen, map, overview map) or a GIANT high res image. I hereby propose FLE-V a subset benchmark for visual models where they just turn a factorio image into a proper FLE description. And maybe the overview and map images as well.
Re:Show HN: Factorio Learning Environment – Agents Build Fac...
by kridsdale1 on Tuesday March 11, 2025 @11:54AM
(#43333720)
Such research could have hundreds of billions of dollars in downstream GDP implications when applied to real industrial settings.
Re:Show HN: Factorio Learning Environment – Agents Build Fac...
by vessenes on Tuesday March 11, 2025 @12:36PM
(#43334227)
Well I better get training!
Re:Show HN: Factorio Learning Environment – Agents Build Fac...
by dismalpedigree on Tuesday March 11, 2025 @06:02PM
(#43337542)
Not to mention the increased productivity of everyone not wasting their time in factorio (myself included) because the optimal solution is known.
Re:Show HN: Factorio Learning Environment – Agents Build Fac...
by lukan on Wednesday March 12, 2025 @01:33AM
(#43340237)
Not wasted time, you were doing research it seems.
Re:Show HN: Factorio Learning Environment – Agents Build Fac...
by dismalpedigree on Wednesday March 12, 2025 @09:44PM
(#43349602)
Good point. My wife will surely understand if I explain it as “research”
Good point with MCP as well given it has been blowing up lately, we'll look into that!