Re:Odds Are, It's Wrong
by PhysicsAndYou on Tuesday March 30, 2010 @03:44PM
(#1229964)
That isn't the only problem addressed.
Misinterpretation and/or abuse of statistics is prevalent in scientific literature more often then you would think. Repeatability, consensus and peer review are good ways of minimizing this problem but it is still true that any random paper you open on say arXiv or even a standard journal is probably going to contain some form of abuse intentional or not.
Is this a serious problem? Mostly in those fields plagued by low confidence results and heavy approximations being made but it exists in all levels.
The article is rather alarmist though for my taste.
The difficulty is that in biology, psychology, and other really complicated systems, attaining even two or three sigma can be difficult and expensive. That suggest that we should continue to use low-confidence results... but accept their tentative nature instead of bestowing them with the aura of truth.
And before you start treating a few hundred thousand people with a drug, get a bigger sample size. :)