Researchers unveil a pruning algorithm to shrink deep learning models

Re: Researchers unveil a pruning algorithm to shrink deep le... by CShorten on Friday May 08, 2020 @05:50PM (#23119911)

Check out our interview on Machine Learning Street Talk with Jonathan Frankle explaining Rewinding and why you can only reset the Learning Rate rather than the weights! https://www.youtube.com/watch?v=SfjJoevBbjU&t=1177s

[ Parent | on HN ]

Re: Researchers unveil a pruning algorithm to shrink deep le... by kaaloo on Saturday May 09, 2020 @02:01AM (#23122658)

Thanks! I really enjoyed the group conversation format and I am looking forward to seeing some more of your content.

[ Parent | on HN ]

Re: Researchers unveil a pruning algorithm to shrink deep le... by p1esk on Friday May 08, 2020 @10:45PM (#23121762)

Interesting, he thinks "there has not been much progress in pruning NNs in the last 10 years". Maybe he meant that it's often possible to train a non-pruned network of the same size as the pruned network, and achieve a similar accuracy.

[ Parent | on HN ]