Re:Double Descent in Human Learning
by sebzim4500 on Wednesday April 26, 2023 @09:30AM
(#35713361)
OpenAI paper on double descent: https://arxiv.org/pdf/1912.02292.pdf
They show it happens across a variety of architectures and real world datasets
By the way, the linked Colab notebook is missing a "self." in front of the "lamb" in the unused regularization branch of the fit function.