Re:Understanding Neural Networks Through Deep Visualization
by shahar2k on Wednesday July 08, 2015 @07:14PM
(#9855240)
So if it were possible to read a single neuron in the brain, and optimize input through its' signal would it be similarly possible to extract what triggers that neuron from such a setup?
[ Parent
| on HN ]
Re:Understanding Neural Networks Through Deep Visualization
by cafebeen on Wednesday July 08, 2015 @07:29PM
(#9855303)
Yes, there's a technique called single-unit recording:
https://en.wikipedia.org/wiki/Single-unit_recording
I think it's pretty rare to see an very selective response though, unless you're looking close to sensory neurons.
Re:Understanding Neural Networks Through Deep Visualization
by nickledave on Wednesday July 08, 2015 @08:46PM
(#9855590)
There's definitely selective responses in single unit recordings, even upstream of sensory neurons in "higher" areas; look for articles on the "Jennifer Aniston cell" and on so-called mirror neurons. The question is, how come you can fool a DNN into classifying noise as something with high probability (as they explain in the article), but you can't fool the brain?
Re:Understanding Neural Networks Through Deep Visualization
by fr0styMatt2 on Wednesday July 08, 2015 @10:37PM
(#9855885)
I think it's actually quite common that you can; see for example Pareidolia: https://en.wikipedia.org/wiki/Pareidolia)
This page links to some YouTube examples: http://theness.com/roguesgallery/index.php/skepticism/audio-...
Re:Understanding Neural Networks Through Deep Visualization
by gwern on Wednesday July 08, 2015 @09:43PM
(#9855758)
> but you can't fool the brain?
How do you know you can't? No brain of any kind has been scanned and emulated to the point where you could try such a gradient-ascent method.
Re:Understanding Neural Networks Through Deep Visualization
by nickledave on Thursday July 09, 2015 @01:19AM
(#9856274)
Have you ever mistaken "color TV static" for a king penguin? If not, then your built in DNN does a good job of discriminating between them. There are optical illusions that mess with our visual system, of course. You could I guess do something like raise a brain in one environment with statistics different from the natural world and then ask how that affects discrimination. Is that what you're getting are with "a gradient ascent method"? Because AFAIK we also don't have any proof the brain uses a gradient ascent algorithm so I'm not sure why you'd ask an in silico brain to carry one out
Re:Understanding Neural Networks Through Deep Visualization
by TheEzEzz on Thursday July 09, 2015 @01:52AM
(#9856350)
Gradient ascent is what you use to find the image that tricks the DNN. If you could run repeated experiments on a brain in exactly the same state over and over then you could perform gradient ascent on a brain as well. Whether the result of that hypothetical would be static that tricks the brain is unknown, but I don't see any reason to assume one way or the other. An easier experiment to help the discussion would be to calculate the probability that a random image of static can fool a DNN, rather than a special designed image that appears like noise. If the probability is not vanishingly small then there is indeed something fundamentally different at a functional level between brains and DNN. If not then we have to work harder to answer that question.
Re:Understanding Neural Networks Through Deep Visualization
by cafebeen on Wednesday July 08, 2015 @11:13PM
(#9855980)
Yes, aka the "grandmother cell" hypothesis. I think those studies are interesting, but pretty limited given the number of neurons in a brain and how many you can (ethically) measure...
Re:Understanding Neural Networks Through Deep Visualization
by chestervonwinch on Wednesday July 08, 2015 @10:00PM
(#9855796)
http://www.nature.com/nature/journal/v435/n7045/abs/nature03...
edit: woops. I mean to respond to GP.
Re:Understanding Neural Networks Through Deep Visualization
by jcr on Wednesday July 08, 2015 @11:37PM
(#9856033)
Here is the non-paywalled copy:
Re:Understanding Neural Networks Through Deep Visualization
by shahar2k on Thursday July 09, 2015 @12:02AM
(#9856080)
can this be done in a non-invasive way?