Just needs integration with popular game engines like UE and unity3d, at the moment it mostly works with 8bit game emulators
Here's what you need to make an Ai Gym :
> Physics engine (pick your open source package)
> Simulator (pick your open source package)
> Write a thin wrapper around it
It can be done and has been done by many individuals in less than a week or two of dedicated work.
Maybe I am also not being very clear, but I am actually visualizing a game which is popular enough to attract a lot of gameplay, but has gameplay elements which are actually the kinds of things which the AI problems are trying to solve. E.g. imagine capturing gameplay from a popular multiplayer drone game to improve drone navigation.
Drones apparently don't fly very well autonomously.
http://spectrum.ieee.org/automaton/robotics/drones/skydio-ca...
Now, imagine if it were possible to get open data where any researcher or group could work on this problem using a gameplay dataset. Perhaps someone with an unexpected take on the problem could make some important contribution?
I wonder if it will be a chicken and egg problem though? Maybe you cannot even create decent gameplay without already having a trove of data, but bad gameplay will not attract more data from potential players?