News for hackers. Stuff that matters.

A comment on What's Wrong with Deep Learning?. Parent comment

Re:What's Wrong with Deep Learning? by modeless on Sunday June 14, 2015 @04:51PM (#9716296)
> [the brain] is able to do all the things it can do without the luxury of parallel training and tuning.

I beg to differ. Newborn babies can hardly do anything. Their brains are undergoing "parallel training and tuning" 24/7 starting even before they are born. Babies train themselves on thousands of hours of visual stimuli to gain the 3D object recognition capabilities to reliably identify objects such as mugs.

[ Parent | on HN ]
Re:What's Wrong with Deep Learning? by discardorama on Monday June 15, 2015 @01:34AM (#9717682)
Newborn babies can hardly do anything because their parameters have not been set; but their hyperparameters (things like, to use NN analogies: activation function, learning rate, etc.) are baked in.
[ Parent | on HN ]
Re:What's Wrong with Deep Learning? by modeless on Monday June 15, 2015 @01:46AM (#9717719)
Right. Evolution picked the hyperparameters, and experiential learning picks the parameters. (To first order; certainly there are some instinctual behaviors programmed by evolution and I wouldn't be surprised if some hyperparameters are influenced by experience as well.)
[ Parent | on HN ]