Re:What are the limits of deep learning?
by lucidrains on Wednesday January 23, 2019 @05:09PM
(#18983618)
Which makes the compelling results of deep networks even more mysterious. (https://gandissect.csail.mit.edu/) How could we have captured the seemingly enormously complex act of visual object recognition, with all the neurons and synapses and chemicals, in something so crude and simple as backpropagation and stochastic gradient descent with a bunch of ones and zeros? Or perhaps both processes, biological and artificial, point to a more fundamental emergent phenomenon of the computational universe we inhabit?
[ Parent
| on HN ]
Re:What are the limits of deep learning?
by scottlocklin on Wednesday January 23, 2019 @06:07PM
(#18984141)
I'm pretty sure if you threw the number of grad students and GPUs at PGMs or various ensemble techniques, the results wouldn't be very different. Fundamentally prediction as we do it is just a form of data compression.
I don't think brains work in a way we understand at all (though pieces like visual cortex are well understood).