Re:Differentiable Neural Computers
by empath75 on Thursday October 13, 2016 @11:17AM
(#12701283)
Feeding mp3s to an image recognition neural net. And as soon as I typed that, I want to try it.
[ Parent
| on HN ]
Actually, in the architecture you described, if there is a planning net that's connected to image net and an audio net, rather than feeding audio to the image net I think synesthesia would be better modeled by feeding the output of the audio net into the image net's input on the planning net. If that makes sense.
Not the output. Making several single connections from intermediate layers from the different nets.
CNNs can actually be used for audio tasks too, on spectrograms