Re:A New Lens on Understanding Generalization in Deep Learning
by ansk on Sunday March 21, 2021 @02:19AM
(#26528496)
I glanced over the paper and it appears that the generative model used for cifar-5m wasn't even trained with a proper train/test split. It was simply trained until the FID on the training set stopped decreasing. That's a pretty good way to overfit a model -- especially on a dataset as small as cifar-10 -- so it's hard to trust that cifar-5m is a decent proxy for the underlying cifar-10 data distribution.
[ Parent
| on HN ]
There are no comments on this comment yet.