News for hackers. Stuff that matters.

A comment on The Transformer Family. Parent comment

Re:The Transformer Family by polygamous_bat on Sunday January 29, 2023 @04:09PM (#34572784)
What you are describing is known as the "lottery ticket hypothesis" [0] in the ML world -- it is a well-studied phenomenon!

[0] https://arxiv.org/abs/1803.03635

[ Parent | on HN ]
Re:The Transformer Family by tehnub on Sunday January 29, 2023 @08:13PM (#34574708)
Another article on this blog talks about it: https://lilianweng.github.io/posts/2019-03-14-overfit/#the-l...
[ Parent | on HN ]