Re:Reinforcement learning’s foundational flaw
by batmansmk on Monday July 09, 2018 @06:30PM
(#17493931)
Sc2 is deterministic. A replay file is simply a record of all actions performed. There is no randomness in the action resolutions, which allows actions to be the only thing needed to be streamed over to dync game states.
[ Parent
| on HN ]
Re:Reinforcement learning’s foundational flaw
by alcinos on Tuesday July 10, 2018 @06:06AM
(#17496746)
Well it's deterministic once you know the random seed, which is stored in the replay file. An agent doesn't know the seed, hence cannot predict the exact outcome of its actions, only a probability over the outcomes. So, from the agent's perspective, the game is indeed random.