News for hackers. Stuff that matters.
Re:The declining authority of statistics and the experts who... by mikeash on Saturday January 21, 2017 @07:39PM (#13452929)
Surveys make gigantic assumptions, namely that the sampling is random or representative or can be made so.

How do you take a random sample of Americans? If you call landlines, you'll be heavily biased toward the demographic that has landlines. If you call cell phones too, you'll be biased toward the demographic that has phones. You'll also be biased toward people who answer calls from numbers they don't recognize, and are willing to spend ten minutes talking to a stranger about whatever.

You can survey people in the street, but then you're biased toward people who go out more, and again biased toward people willing to spend ten minutes talking to a stranger.

Obviously they know about these problems and try to compensate for them. And I'm sure they usually do a pretty good job of compensating. But that compensation involves a lot of modeling and assumptions.

There are no comments on this comment yet.