News for hackers. Stuff that matters.
Re:How TensorFlow outdid itself in handling Overfitting in D... by jphoward on Thursday July 18, 2019 @07:00AM (#20468531)
Ignoring the fact that the title of this post is misleading and also not used by the linked article, I was interested to read that MaxNorm was _so_ effective. In my experience it is rarely used in the state-of-the-art ConvNets, though maybe that is because they are trained on large ImageNet datasets where overfitting is less of an issue? Weight decay/L2 norm seems almost ubiquitous is comparison.

Have other HN readers found MaxNorm to be that useful? Am I missing out?

There are no comments on this comment yet.