Re:An overview of the theory of overparameterized machine le...
by nexuist on Tuesday September 21, 2021 @12:31PM
(#28606752)
Is this the ML equivalent of Dunning–Kruger effect? A model with a bit of data is too afraid of being wrong to be overconfident. A model with a bit more data is overconfident in itself and gets things wrong. Finally, a model with tons and tons of data understands the complexity of the problem set and once again becomes too afraid of being wrong.
[ Parent
| on HN ]
Re:An overview of the theory of overparameterized machine le...
by visarga on Tuesday September 21, 2021 @12:55PM
(#28607028)
Model confidence as reported by softmax probability scores is notoriously noisy and miscalibrated. With larger models and more data the confidence estimation gets more nuanced.