News for hackers. Stuff that matters.
Re:A New Lens on Understanding Generalization in Deep Learning by choppaface on Sunday March 21, 2021 @03:04PM (#26532945)
You're not ablating anything there. What happens when Train Infinity (Train 150K) doubles in size (to Train Infinity_2 -> 300K)? What happens when you add an unseen class? These are real-world conditions that hamper existing theoretical estimation of the generalization gap-- the "ideal world" always gets larger. In Bengio's group paper (Predicting the Generalization Gap https://arxiv.org/pdf/1810.00113.pdf ) they actually do these sorts of ablations.

Also, you use K (thousands) and $K$ (latex K) interchangeably; it's really hard to decipher is K is a variable or what you mean.

There are no comments on this comment yet.