News for hackers. Stuff that matters.
Re:Playing hard exploration games by watching YouTube by sleepychu on Wednesday May 30, 2018 @08:54AM (#17187269)
Neat, I don't understand what they mean by having embedded a reward video into the set. Is that a video where copying the behaviour will deliver victory?
Re:Playing hard exploration games by watching YouTube by algon33 on Wednesday May 30, 2018 @11:45AM (#17188640)
Yes, they take the state of the video every 16 frames and look at its embedding. These were made into checkpoints.

The AI is rewarded if at each checkpoint the state vector its produced is sufficiently aligned with the videos.

I guess that's the initial training to deal with sparse rewards.

Re:Playing hard exploration games by watching YouTube by eric_h on Wednesday May 30, 2018 @12:39PM (#17189179)
here's video of the agent actually playing (linked in the paper): https://www.youtube.com/watch?v=Msy82sIfprI
Re:Playing hard exploration games by watching YouTube by jexah on Wednesday May 30, 2018 @09:14AM (#17187381)
This is really cool. A step in the right direction towards general learning through observation.
Re:Playing hard exploration games by watching YouTube by erikb on Wednesday May 30, 2018 @12:30PM (#17189104)
This is actually quite human. I also watch Let's plays if I struggle with a quest (or game in general).

Also interesting assumption to say "harder = fewer rewards". Probably doesn't always apply but is a good generalization.

Re:Playing hard exploration games by watching YouTube by jonbaer on Wednesday May 30, 2018 @09:35AM (#17187496)
Are audio cues also analyzed here? ie: "We observe that use of the audio signal in CMC results in more emphasis being placed on key items and their location in the inventory"
Re:Playing hard exploration games by watching YouTube by maffydub on Wednesday May 30, 2018 @09:43AM (#17187544)
Yes. s3.2 suggests they use audio cues to help them align the video frames from different videos. (I guess it's easier to correlate audio than video.)
Re:Playing hard exploration games by watching YouTube by Cthulhu_ on Wednesday May 30, 2018 @10:12AM (#17187760)
I can imagine video quality on youtube varies more than audio, or that audio is easier to hash / make signatures of.
Re:Playing hard exploration games by watching YouTube by jonbaer on Wednesday May 30, 2018 @10:20AM (#17187830)
Hmm I was more under the impression it was for context, in other words creating/executing strategies based on what audio cues were received (like when a key or coin is acquired) and keeping tabs of what actions the user performed after that point.
Re:Playing hard exploration games by watching YouTube by navaati on Wednesday May 30, 2018 @08:55AM (#17187279)
This should probably say "ML" or "AI" or whatever, I was slightly disappointed to realize it was not a funny paper about… I don't know to be fair.
Re:Playing hard exploration games by watching YouTube by zodPod on Wednesday May 30, 2018 @01:56PM (#17189937)
I can see where you're coming from, the title definitely made me initially feel like it was going to be about getting satisfaction from watching other people play a game or something like that.