News for hackers. Stuff that matters.

A comment on Neurogenesis Deep Learning. Parent comment

Re:Neurogenesis Deep Learning by Vitrified on Wednesday December 14, 2016 @04:45AM (#13174870)
Now that is interesting. I hadn't realized methods to combine trained networks so efficiently were already readily available.
[ Parent | on HN ]
Re:Neurogenesis Deep Learning by kajecounterhack on Wednesday December 14, 2016 @01:57PM (#13178638)
Certain companies use these methods to make state of the art neural nets work on your phones :)

Also "combine" might not be the right word, since it's really transfer learning. "Distill" is really a descriptive verb.

Maybe my original wording was confusing; I shouldn't have said "distillation compacts" -- distillation is a process by which you can create a more compact version of a complex neural net.

[ Parent | on HN ]