Re:Human-Level AI Is Harder Than It Seemed in 1955 – John Mc...
by ajtulloch on Wednesday January 28, 2015 @06:16PM
(#8963179)
Deep learning models definitely don't need an "absurdly vast amount of neurons" - for example, GoogLeNet (arguably the state of the art image classification model) has only ~6M parameters.
I would relate it to being a discriminative model, which is tailored to solving a specific task, in contract to generative models, which try to model and explain the world. Perhaps the brain is not meant to understand how the world works but how to do take advantage of it.