News for hackers. Stuff that matters.

A comment on A Bayesian Perspective on Generalization and Stochastic Gradient Descent. Parent comment

Re:A Bayesian Perspective on Generalization and Stochastic G... by mlthoughts2018 on Sunday December 09, 2018 @09:46AM (#18641052)
Yeah, I agree that gaydar example illustrates your point, but it’s just such an egregious outlier that overall it just further refutes the idea that this distinction matters much.

About zero serious, mainstream papers or open-source libraries or business case studies each year resemble the poor experiment design from that gaydar paper. It’s a silly one to emphasize in terms of generalization error except I guess for basic 101 pedagogy for people who have never worked with models like this before.

[ Parent | on HN ]
Re:A Bayesian Perspective on Generalization and Stochastic G... by YeGoblynQueenne on Sunday December 09, 2018 @01:12PM (#18642278)
It's an especially egregious example, but everybody makes assumptions that they can't guarantee will hold.
[ Parent | on HN ]
Re:A Bayesian Perspective on Generalization and Stochastic G... by mlthoughts2018 on Sunday December 09, 2018 @10:33PM (#18644979)
The first part of your comment doesn’t seem related to the second part, and neither part seems related to the question of whether most applied problems do or do not benefit from making a distinction between the sampling distribution used for generating training and test data and the “true” distribution.
[ Parent | on HN ]