News for hackers. Stuff that matters.
Re:There Will Be a Scientific Theory of Deep Learning by hodgehog11 on Saturday April 25, 2026 @08:19AM (#47900855)
Couldn't have said it better, although this is only for grokking with the modular addition task on networks with suitable architectures. L1 regularization is absolutely a clear form of compression. The modular addition example is one of the best cases to see the phenomenon in action.

There are no comments on this comment yet.