Re:Neurons that fire together, wire together, but how?
by pshc on Monday June 29, 2020 @08:52PM
(#23685336)
Would you say you found a result similar to the lottery ticket hypothesis? https://arxiv.org/abs/1803.03635
[ Parent
| on HN ]
Re:Neurons that fire together, wire together, but how?
by londons_explore on Tuesday June 30, 2020 @02:38AM
(#23687277)
Not really - I had to do multiple steps of 'prune a bit, train a bit' to be able to prune to 99%. If I had done all the pruning in one big step as they do, I don't think it would have trained well, even if I had been able to see the future and remove the same weights.