News for hackers. Stuff that matters.
Re:Differentiable Neural Computers by empath75 on Thursday October 13, 2016 @10:51AM (#12701106)
The brain is not a single universal neural network that does everything well. It's a collection of different neural networks that specialize in different tasks, and probably use very different methods to achieve them.

It seems like the way forward would be networking together various kinds of neural networks to achieve complex goals. For example, an NTM specialized in formulating plans that has access to a CNN for image recognition, and so on.

Re:Differentiable Neural Computers by vinay427 on Thursday October 13, 2016 @11:01AM (#12701167)
This is being done using various types of networks. See these slides on image captioning by Karpathy for an example using a CNN and RNN: http://cs.stanford.edu/people/karpathy/sfmltalk.pdf
Re:Differentiable Neural Computers by Senji on Thursday October 13, 2016 @10:59AM (#12701157)
If we're going with a brain metaphor. What would be the those neural networks' version of synesthesia?
Re:Differentiable Neural Computers by empath75 on Thursday October 13, 2016 @11:17AM (#12701283)
Feeding mp3s to an image recognition neural net. And as soon as I typed that, I want to try it.
Re:Differentiable Neural Computers by modeless on Thursday October 13, 2016 @01:45PM (#12702606)
Actually, in the architecture you described, if there is a planning net that's connected to image net and an audio net, rather than feeding audio to the image net I think synesthesia would be better modeled by feeding the output of the audio net into the image net's input on the planning net. If that makes sense.
Re:Differentiable Neural Computers by Senji on Thursday October 13, 2016 @02:18PM (#12702841)
Not the output. Making several single connections from intermediate layers from the different nets.
Re:Differentiable Neural Computers by dharma1 on Thursday October 13, 2016 @02:11PM (#12702788)
CNNs can actually be used for audio tasks too, on spectrograms
Re:Differentiable Neural Computers by Senji on Friday October 14, 2016 @05:51AM (#12707038)
It's how some guys defeated the first iteration of recaptcha's audio mode. Then google replaced it with something very annoying to use even for humans.