Re:Show HN: Factorio Learning Environment – Agents Build Fac...
by martbakler on Tuesday March 11, 2025 @01:14PM
(#43334754)
We are thinking of something like this (a curriculum approach) for further training. The reason why we didn't want to do this for current work, where the emphasis is on evaluations, is that the "difficulty level" of different tasks is quite subjective and hence we would need to make arbitrary decisions that could affect the evals (i.e which tasks would follow which scenarios, how to ensure sufficient coverage across all difficulty levels etc)
[ Parent
| on HN ]
Re:Show HN: Factorio Learning Environment – Agents Build Fac...
by infogulch on Tuesday March 11, 2025 @02:04PM
(#43335321)
"a curriculum approach" is a nice way to put it!
> the difficulty level of different tasks is subjective
That makes sense. I wonder if difficulty of different scenarios could be derived by assuming a partial ordering and ranking based on training rate: e.g. it preforms better at scenario T if it trains scenario A first, but training scenario first B doesn't help with T. Then infer A < T, and B ? T.