Re:OpenAI at the Dota 2 World Championships
by popcorncolonel on Friday August 11, 2017 @10:26PM
(#14996047)
It would be pretty much impossible for the programmers to "build the behavior in" to the neural network, unless you mean training on supervised data or something.
Re:OpenAI at the Dota 2 World Championships
by visarga on Saturday August 12, 2017 @12:51AM
(#14996529)
It's not impossible, it's called inverse reinforcement learning, where they learn a value function from an external demonstration. Then they use this value function for teaching the bot an action policy. Intuitively, the idea is to learn first what are a good state and a bad state, based on external demonstrations, then use that to teach the bot how to act.
This kind of learning is similar to GANs, where the discriminator learns from real data and the generator learns from the discriminator.
Re:OpenAI at the Dota 2 World Championships
by popcorncolonel on Wednesday August 16, 2017 @01:09PM
(#15029174)
Very interesting! Thanks for sharing -- I'll look more into this.
In the video, we see the bot "creep blocking." For those unfamiliar with dota, players can use the model of the unit they control to obstruct the movement of allied computer controlled units in order to gain a favorable position.
I suppose it's possible that over millions and millions of matches played against itself, the OpenAI bot "invented" this behavior for itself. But it seems more likely to me that the programmers "built that behavior in."