Neurogenesis Deep Learning

Re:Neurogenesis Deep Learning by cing on Tuesday December 13, 2016 @06:24PM (#13172265)

I believe several papers have examined efficiently pruning neural networks, but neural death would be better branding ;) (https://arxiv.org/pdf/1506.02626v3.pdf https://arxiv.org/pdf/1510.00149v5.pdf)

[ Parent | on HN ]

Re:Neurogenesis Deep Learning by simonster on Tuesday December 13, 2016 @06:58PM (#13172545)

Yann LeCun called a technique for pruning weights "optimal brain damage" back in 1990: http://yann.lecun.com/exdb/publis/pdf/lecun-90b.pdf

[ Parent | on HN ]

Re:Neurogenesis Deep Learning by SimonKinds on Wednesday December 14, 2016 @02:16AM (#13174396)

There is also this one https://arxiv.org/abs/1506.02515 which takes pruning a step further to reduce the sparsity. Also this one https://arxiv.org/abs/1608.04493 which makes sure not to kill any neurons which proves to be useful at a later stage in the pruning process.

[ Parent | on HN ]