Re:The Cost of Not Understanding Probability Theory
by nkurz on Monday August 24, 2009 @07:28PM
(#783662)
I appreciate your response and voted it up. But I disagree that there is no benefit to actually testing his hypothesis. The mathematics don't need to be 'tested', but perhaps the priors do? For example, how certain are you of the assumption that the questions that we need to flip the coin for are evenly distributed between true and false?
It seems plausible that a test might have a bias whereby the harder questions are predominately one answer or the other. How large would this effect have to be to overwhelm the 2% probability? Would you trust your grade on the presumption that this effect can be ignored? What about your life?
For the record, I agree with Yvain's advice. I did just fine on the SAT's, partly because I followed the mathematically correct advice that one should guess if one can eliminate at least one of the 4 choices. But I wouldn't proclaim that this strategy needs no testing just because the mathematics are correct.
It seems plausible that a test might have a bias whereby the harder questions are predominately one answer or the other. How large would this effect have to be to overwhelm the 2% probability? Would you trust your grade on the presumption that this effect can be ignored? What about your life?
For the record, I agree with Yvain's advice. I did just fine on the SAT's, partly because I followed the mathematically correct advice that one should guess if one can eliminate at least one of the 4 choices. But I wouldn't proclaim that this strategy needs no testing just because the mathematics are correct.