News for hackers. Stuff that matters.

irinarish

Re:Neurogenesis Deep Learning on Monday December 19, 2016 @11:27AM (#13212485)
A good point was made that a model of neurogenesis must also incorporate neuronal death besides neuronal birth (since hippocampus and the brain as a whole have physical constraints, you can't keep growing your network infinitely :). That's why any model of neurogenesis must incorporate interplay between birth and death of new (and old) neurons; that's was the main idea of the paper I mentioned in an earlier post (this year ICLR submission https://openreview.net/forum?id=HyecJGP5ge) Note that just adding nodes to networks was proposed before, eg. the classical work on cascade correlations.
Re:Neurogenesis Deep Learning on Sunday December 18, 2016 @07:30PM (#13208596)
For a model that incorporates both neuronal birth and death, see ICLR submission at OpenReview:

https://openreview.net/revisions?id=HyecJGP5ge

NEUROGENESIS-INSPIRED DICTIONARY LEARNING: ONLINE MODEL ADAPTION IN A CHANGING WORLD Sahil Garg, Irina Rish, Guillermo Cecchi, Aurelie Lozano

Re:Neurogenesis Deep Learning on Sunday December 18, 2016 @07:28PM (#13208592)
Exactly!

For that, check out our OpenReview ICLR submission on NEUROGENESIS-INSPIRED DICTIONARY LEARNING: ONLINE MODEL ADAPTION IN A CHANGING WORLD, by Sahil Garg, Irina Rish, Guillermo Cecchi, Aurelie Lozano https://openreview.net/revisions?id=HyecJGP5ge