News for hackers. Stuff that matters.

A comment on What's Wrong with Deep Learning?. Parent comment

Re:What's Wrong with Deep Learning? by discardorama on Monday June 15, 2015 @12:09AM (#9717477)
> Max pooling tests if a feature occurs anywhere in a certain area, rather than being sensitive to the exact location.

From Geoff Hinton's AMA on Reddit: The pooling operation used in convolutional neural networks is a big mistake and the fact that it works so well is a disaster.

[ Parent | on HN ]
Re:What's Wrong with Deep Learning? by Houshalter on Monday June 15, 2015 @03:36PM (#9721486)
Hinton doesn't like that pooling loses track of the exact locations where features are located, and just tests if a feature occurs in some area.

The basic effect of this is to decrease the resolution, so it's more tractable to operate on. Without pooling you are stuck with a huge resolution at each layer.

[ Parent | on HN ]