News for hackers. Stuff that matters.
Re:Why I’m Remaking OpenAI Universe by gdb on Monday June 26, 2017 @11:34AM (#14637581)
(I work at OpenAI.)

Great project. We've found that the VNC Universe environments are hard for today's RL algorithms primarily due to the their async nature. We're currently working on a new set of Universe environments without VNC; I'm very happy to see others inspired by the core ideas of Universe as well.

Re:Why I’m Remaking OpenAI Universe by unixpickle on Monday June 26, 2017 @01:23PM (#14638580)
(Author here). Hi Greg! I am excited to hear about the new Universe environments. I want as many RL environments as possible for my upcoming project, so I will probably draw from Universe and ALE as well as µniverse.

I took a lot of inspiration from Universe and am grateful for OpenAI's work on RL in general :). I probably wouldn't have started on this project if a company like OpenAI hadn't already decided it was a worthy goal.

Re:Why I’m Remaking OpenAI Universe by pixelHD on Monday June 26, 2017 @02:16PM (#14639003)
honest question, how interested is the academia/industry in deep learning libraries & game engines integrations? I've worked on unreal and tensorflow the last semester, and I found out that there aren't any existing integrations. I will probably work on a plugin, but I wanted to know if there is any interest?

The way I see it, having hooks into the engines themselves helps with what the article talks about - not needing to go through VNCs or other _glue_ to get realtime data. It could potentially send the framebuffers themselves directly from the game/simulation and tie in the actions back to the game/simulation. And using framebuffers is just one direction, we could instead stream the co-ords/the current payoff/etc.

Also, having such plugins would help with the adoption in both directions - games now have an always updating/learning AI (might need a network connection + cloud backend), and researchers can have training/testing environments.

Re:Why I’m Remaking OpenAI Universe by evc123 on Monday June 26, 2017 @02:26PM (#14639076)
Arthur Juliani is about to open source his interface for connecting ML agents to Unity3D game engine: https://twitter.com/awjuliani/status/879142906178785281
Re:Why I’m Remaking OpenAI Universe by pixelHD on Monday June 26, 2017 @03:11PM (#14639405)
Wow, that looks great! I guess that's what i'm intending to do with unreal.
Re:Why I’m Remaking OpenAI Universe by Aqueous on Monday June 26, 2017 @12:44PM (#14638139)
It seems like you might be duplicating work? At the end he mentions he's dropping VNC in favor of headless Chrome.
Re:Why I’m Remaking OpenAI Universe by du_bing on Monday June 26, 2017 @12:52PM (#14638227)
Oh, Greg, nice to see you here, I am eager to see some solid Universe environments without VNC, that will be interesting.
Re:Why I’m Remaking OpenAI Universe by evc123 on Monday June 26, 2017 @12:51PM (#14638211)
recruit Alex Nichol (unixpickle).