News for hackers. Stuff that matters.

A comment on Notes on Weight Initialization for Deep Neural Networks. Parent comment

Re:Notes on Weight Initialization for Deep Neural Networks by iXce on Tuesday May 21, 2019 @12:51AM (#19967629)
As far as I understand there is no quick magic algorithm to find them: you train the full architecture as usual the long and hard way, then you identify the right subnetwork and you can retrain faster from the architecture and initialization of just this subnetwork
[ Parent | on HN ]
Re:Notes on Weight Initialization for Deep Neural Networks by L2R on Wednesday May 22, 2019 @01:20PM (#19983284)
Based off of the results, you have to train a larger number of architectures to identify the right subnetwork.
[ Parent | on HN ]