Re:Interpreting Noise
by yummyfajitas on Saturday April 19, 2014 @12:27AM
(#7612594)
I get the point you are making, but confidence intervals are completely the wrong solution. They do NOT mean what you probably think they mean (where "you" is a generalized "you the reader").
http://www.ejwagenmakers.com/inpress/HoekstraEtAlPBR.pdf
Credible intervals are probably what you want. A lot of the time people misunderstand confidence intervals and treat them like credible intervals.
I get that people often need so-called "killer facts" — quick statistics that make an impression in press releases — but confidence intervals are more honest and they don't take much longer to communicate. Instead of allowing people to say that "x% of users prefer...", let's say that "x-y% of users prefer."