Re:Machine Learning Crash Course: The Bias-Variance Dilemma
by joshuamorton on Monday July 17, 2017 @05:52PM
(#14792574)
The other common example of the same phenomena is a test for a deadly genetic defect with a 1% false positive rate. If the incidence of the defect is .01% and you test positive, its actually more likely that you don't have the disease. (although this can be solved with bayesianism over frequentism).
Re:Machine Learning Crash Course: The Bias-Variance Dilemma
by gpawl on Monday July 17, 2017 @09:22PM
(#14793694)
This is a pernicious misunderstanding of "frequentism", often found among people who studied statistics mainly by reading comics.
http://web.archive.org/web/20130117080920/http://andrewgelma...
Re:Machine Learning Crash Course: The Bias-Variance Dilemma
by joshuamorton on Tuesday July 18, 2017 @11:40AM
(#14797385)
That's incredibly unnecessary. My understanding of statistics is not derived from comics (and the first time I heard that example was in a statistics course), and the link you post doesn't actually address what I stated. It addresses an actual mistake in the comic, which is a mistake that I didn't make.
Here's Andrew, the author of that blog post:
> Yes, I think it makes a lot of sense to criticize particular frequentist or Bayesian methods rather than to criticize freq or Bayes statisticians.
Which is exactly what I did. There are times when frequentist methods are effective. I just wouldn't use them to tell me that I have a disease.
Re:Machine Learning Crash Course: The Bias-Variance Dilemma
by corey_moncure on Monday July 17, 2017 @04:47PM
(#14792145)
Doesn't this make the assumption that "illegal immigrants" won't check the wrong box, intentionally or by accident?
Re:Machine Learning Crash Course: The Bias-Variance Dilemma
by Double_Cast on Monday July 17, 2017 @05:26PM
(#14792397)
citizens labeled illegals: 1,000,000
illegals labeled citizens: 0.01
Re:Machine Learning Crash Course: The Bias-Variance Dilemma
by 0xbear on Monday July 17, 2017 @11:12PM
(#14794039)
Illegal immigrants have no business being anywhere near that particular checkbox.
Re:Machine Learning Crash Course: The Bias-Variance Dilemma
by dopamean on Monday July 17, 2017 @02:26PM
(#14791110)
If you could find a link to the FiveThirtyEight article I'd really appreciate it. Thanks.
Re:Machine Learning Crash Course: The Bias-Variance Dilemma
by foota on Tuesday July 18, 2017 @12:49AM
(#14794317)
It's linked in the grandparent's comment. https://fivethirtyeight.com/features/trump-noncitizen-voters...
It's a very good article, though in the context of deciding how many variables should be in a model of some complex phenomenon, this example is a little tougher to wrap your head around. It's not quite a predictive model, but there were some variables left out. A naive model I suppose is "this data is generated by infallible respondents", whereas a better model would incorporate that error rate. There isn't as much of a question about which pieces of information are relevant, though, like you might encounter when trying to predict future drug use from household income, race, age, number of books read as a child, number of pets, and so on.