News for hackers. Stuff that matters.
Re:Deep Reinforcement Learning by ehsanu1 on Saturday June 18, 2016 @12:22AM (#11927097)
Aha, so that's what (human) dreaming is for.
Re:Deep Reinforcement Learning by Houshalter on Saturday June 18, 2016 @01:35AM (#11927244)
IIRC there is evidence rats replay their experiences, sped up, while they are asleep. Dreaming may be something else entirely though, because my dreams aren't anything like my memories of the day before.

Artificial neural networks can "dream" by predicting what frame it will see next. This is a really cool technique. They've shown slightly blurry videos of atari games being played that comes entirely from the network's dream. With no interaction with the game at all. You can even train the reinforcement learning on the dream sequences and improve it's performance.

But this also doesn't seem quite like what human dreams are. Human dreams are wild and unrealistic, while the NN dreams try to match the training data as closely as possible.

Re:Deep Reinforcement Learning by glial on Saturday June 18, 2016 @10:17AM (#11928706)
> IIRC there is evidence rats replay their experiences...

https://en.wikipedia.org/wiki/Hippocampal_replay

for anyone that's interested.

Re:Deep Reinforcement Learning by chris_st on Saturday June 18, 2016 @10:16AM (#11928704)
Quite a few of my dreams seem to be slightly scary situations (dangerous behavior of other drivers while I'm driving, for example).

This makes me think that we have a "scenario generation" engine as part of our brains, and so we're being presented with novel experiences (often "wild and unrealistic") to react to.

So this seems to be a pretty big step beyond the idea of presenting previously seen situations (which sounds like a really good first step, of course).

Re:Deep Reinforcement Learning by Jabbles on Saturday June 18, 2016 @11:01AM (#11928896)
You can even train the reinforcement learning on the dream sequences and improve it's performance.

I'm not sure how that would work. Surely you'd be overfitting on your training set by definition?

Re:Deep Reinforcement Learning by Houshalter on Saturday June 18, 2016 @02:20PM (#11929892)
Reinforcement learning has a problem in that it gets very little labelled data. You may have a million frames, but the only label is the score. Which may only change a few times per game.

Training the net to predict the next frame is sort of unsupervised learning. It can learn the rules of the game without score information at all.

The second thing is that RL is different than prediction. Even if you can predict the next frame exactly, finding the optimal set of moves is still a hard problem. The algorithm needs to learn more than just predicting what will happen, but also what the optimal action is in every situation. That is something that can be practiced in simulations, or "dreams".

Re:Deep Reinforcement Learning by aivosha on Saturday June 18, 2016 @11:19AM (#11928979)
i have read somewhere the dreams are for training purposes and present the dreamer situations either from the past or present or combination. that would explain why dreams are mostly dangerous or "wild". this is how our mind tries to figure out how to deal with those situations in the future. good examples of this are same recurring dreams over and over. and also i think there is no sense of time in the brain while dreaming so it does not differentiate childhood "situations" from any current ones. It just keeps fucking trying to solve that damn math exam problem....
Re:Deep Reinforcement Learning by justifier on Saturday June 18, 2016 @03:34AM (#11927474)
i've dreamt up a few possible explanations for dreams

currently my favourite is for converting short term to long term memory

my most vivid dreams are when i experience something new, or have an unexpected reminder about something i last thought about years ago

i imagine the surreal nature of the dreamscape is some consequence of developing neuronal paths

storing a new idea about a boat forms a path to a neuronal pathway referencing fire and your dream has you sailing across a sea of fire

Re:Deep Reinforcement Learning by visarga on Saturday June 18, 2016 @01:35AM (#11927245)
I thought it was for regularization.