News for hackers. Stuff that matters.
Re:The Cost of Not Understanding Probability Theory by yummyfajitas on Monday August 24, 2009 @12:30PM (#782502)
Using coin flips gives a terrible example. The odds are actually pretty high that the coin will be heads next.

Suppose there are 1 billion coins in circulation, 100 of which are double sided [1] (due to magicians accidentally spending them, etc). Then:

P(double sided) = 10^{-7}.

P(30 heads in a row) = 10^{-7} + (1-10^{-7}) x 9.31 x 10^{-10} ~= 10^{-7}

P(double sided | 30 heads in a row) = P(30 heads in a row | double sided) x P(double sided) / P(30 heads in a row) = 1 x 10^{-7}/ 10^{-7} = 1

(Via Bayes rule.) So the coin is probably double sided and the gambler is right. The mathematician who lacks common sense is wrong.

Re:The Cost of Not Understanding Probability Theory by acangiano on Monday August 24, 2009 @12:59PM (#782574)
Amusing comment, however a fair coin is not double sided by definition. :)

In any case, I changed the example from 30 to 10 tosses, so that we avoid "missing the forest for the trees".

Re:The Cost of Not Understanding Probability Theory by nkurz on Monday August 24, 2009 @03:00PM (#782959)
But what does a 'fair coin' have to do with bets in the real world? Assume I'm standing on a street corner, flipping a coin . You observe 30 flips, and note that 30 times in a row it comes up heads. I then turn and offer to bet you 2:1 odds that the next flip will also be heads. Would you really take my bet?

No, you would walk away, despite your superior knowledge of probability. But let's say that it was only 10 flips in a row, as in your modified example. Would you stay and bet? If you would, perhaps it is you is is missing the forest. :)

More precisely, perhaps the problem is not their knowledge of probability, but the difficulty of modeling the real world with standard probability theory. The Bayesian approach above at least allows for the possibility that the coin is not fair. How does your model allow for this?

Re:The Cost of Not Understanding Probability Theory by dvvarf on Monday August 24, 2009 @01:01PM (#782582)
When does the author talk about double sided coins? The example is based on the premise that the coin is fair and each toss is independent of the others.
Re:The Cost of Not Understanding Probability Theory by yummyfajitas on Monday August 24, 2009 @01:42PM (#782718)
I'm disputing the premise. The author has a prior, namely "fair coin". I'm suggesting that it's likely that the prior is wrong.
Re:The Cost of Not Understanding Probability Theory by jerf on Monday August 24, 2009 @03:20PM (#783008)
So, what's the alternative? Give up the concept of "fair coin" when trying to teach statistics? This seems unlikely to be a useful pedagogical move! How is anyone supposed to understand Bayes Theorum before they even understand probability?

Mathematicians have to be able to specify priors. Insisting they are unrealistic rather misses the point that the entire reason the phrase "fair coin" appears in the first place is an explicit acknowledgment of the unreality of the situation.

If you want to more rapidly move to a Bayesian system when teaching, I'd understand completely, but we still have to start with "fair coins" before we can get around to considering how to prove they aren't fair. (I will be first in line to say many school teachers, being generally poorly trained in mathematics, completely fail to understand this point, and correspondingly ask the "gotcha" question about "what's after 29 heads?" without fully understanding the issue themselves.)

Re:The Cost of Not Understanding Probability Theory by bravura on Monday August 24, 2009 @02:13PM (#782821)
The point is that common sense forms the basis of our prior knowledge. If your priors are poor, then your probability estimates are going to be inaccurate, even if you know probability theory perfectly.