Re:There Will Be a Scientific Theory of Deep Learning
by hodgehog11 on Saturday April 25, 2026 @08:19AM
(#47900855)
Couldn't have said it better, although this is only for grokking with the modular addition task on networks with suitable architectures. L1 regularization is absolutely a clear form of compression. The modular addition example is one of the best cases to see the phenomenon in action.
[ Parent
| on HN ]
There are no comments on this comment yet.