Re:OpenAI at the Dota 2 World Championships
by PeanutCurry on Friday August 11, 2017 @10:18PM
(#14996009)
This approach seems like it would be more useful for bug discovery than game balancing. Actively collecting a slew of performance metrics, similar to how companies like Blizzard already do, would give you a better idea of how to proceed with balance changes because you can review the data as it applies to your actual playerbase and even organize it based on ranking categories to get an idea of how your decisions would affect players at different skill levels.
Add latency. Limit its actions per minute including camera movements and maybe even inertial limitations of input methods.
And even if the bot is not a perfect imitation of a human it still might figure out surprising things that would take human players years of real time to figure out by chance since they can only spend so much time on playing and experimenting.