News for hackers. Stuff that matters.
Re:Machine Learning Crash Course: The Bias-Variance Dilemma by cromd on Monday July 17, 2017 @02:10PM (#14790958)
If it helps anyone, the FiveThirtyEight article describes a scenario where people take a survey about immigration status and voting. Most legal citizens will correctly identify themselves, but some will accidentally check the wrong box and say they are an illegal immigrant. If you have a billion citizens and 10 illegal immigrants truly taking the survey, and people check the wrong box 1 in 1000 times, your "percentage of illegal immigrants who vote" statistic will be about the same as for citizens (because almost all reported illegals will be citizens). Collecting more data won't help.

It's a very good article, though in the context of deciding how many variables should be in a model of some complex phenomenon, this example is a little tougher to wrap your head around. It's not quite a predictive model, but there were some variables left out. A naive model I suppose is "this data is generated by infallible respondents", whereas a better model would incorporate that error rate. There isn't as much of a question about which pieces of information are relevant, though, like you might encounter when trying to predict future drug use from household income, race, age, number of books read as a child, number of pets, and so on.

Re:Machine Learning Crash Course: The Bias-Variance Dilemma by joshuamorton on Monday July 17, 2017 @05:52PM (#14792574)
The other common example of the same phenomena is a test for a deadly genetic defect with a 1% false positive rate. If the incidence of the defect is .01% and you test positive, its actually more likely that you don't have the disease. (although this can be solved with bayesianism over frequentism).
Re:Machine Learning Crash Course: The Bias-Variance Dilemma by gpawl on Monday July 17, 2017 @09:22PM (#14793694)
This is a pernicious misunderstanding of "frequentism", often found among people who studied statistics mainly by reading comics.

http://web.archive.org/web/20130117080920/http://andrewgelma...

Re:Machine Learning Crash Course: The Bias-Variance Dilemma by joshuamorton on Tuesday July 18, 2017 @11:40AM (#14797385)
That's incredibly unnecessary. My understanding of statistics is not derived from comics (and the first time I heard that example was in a statistics course), and the link you post doesn't actually address what I stated. It addresses an actual mistake in the comic, which is a mistake that I didn't make.

Here's Andrew, the author of that blog post:

> Yes, I think it makes a lot of sense to criticize particular frequentist or Bayesian methods rather than to criticize freq or Bayes statisticians.

Which is exactly what I did. There are times when frequentist methods are effective. I just wouldn't use them to tell me that I have a disease.

Re:Machine Learning Crash Course: The Bias-Variance Dilemma by corey_moncure on Monday July 17, 2017 @04:47PM (#14792145)
Doesn't this make the assumption that "illegal immigrants" won't check the wrong box, intentionally or by accident?
Re:Machine Learning Crash Course: The Bias-Variance Dilemma by Double_Cast on Monday July 17, 2017 @05:26PM (#14792397)
citizens labeled illegals: 1,000,000

illegals labeled citizens: 0.01

Re:Machine Learning Crash Course: The Bias-Variance Dilemma by 0xbear on Monday July 17, 2017 @11:12PM (#14794039)
Illegal immigrants have no business being anywhere near that particular checkbox.
Re:Machine Learning Crash Course: The Bias-Variance Dilemma by dopamean on Monday July 17, 2017 @02:26PM (#14791110)
If you could find a link to the FiveThirtyEight article I'd really appreciate it. Thanks.
Re:Machine Learning Crash Course: The Bias-Variance Dilemma by foota on Tuesday July 18, 2017 @12:49AM (#14794317)
It's linked in the grandparent's comment. https://fivethirtyeight.com/features/trump-noncitizen-voters...