Re:Frequentism and Bayesianism: A Practical Introduction
by judk on Saturday August 30, 2014 @10:37PM
(#8248284)
Um, the folks at CERN don't agree with your assessment of frequentism in science. Their papers are explicitly frequentist, they celebrate results based on how many "sigmas" they get. P-value all the aym
Re:Frequentism and Bayesianism: A Practical Introduction
by bayesianhorse on Sunday August 31, 2014 @12:10AM
(#8248398)
I'm not a physicist, but as far as I know, CERN has access to tons of data with every intention of drowning any prior belief. In this setting, I would expect frequentist methods to shine, and bayesian method to be intractable.
However I would not expect CERN papers to make the kinds of terminological / theoretical lapses about confidence the parent thread was talking about. Papers should be rejected for that kind of error, even if you are not a bayesian.
Re:Frequentism and Bayesianism: A Practical Introduction
by betatim on Sunday August 31, 2014 @03:42AM
(#8248707)
Exactly this. At CERN (and all of HEP elsewhere) the Bayes vs Freq wars were fought many years ago and are long over. The conclusion: when you have lots of data they converge (as they should!).
In the case that they differ you almost always find that you have very few observations. I would argue that this 'difference' is not that exciting because it must be dominated by your assumptions, not your observations. After all once you accumulate enough observations the two methods tend to converge.
Personal conclusion: if the methods disagree work on getting more data instead of fighting over which method is better.
Re:Frequentism and Bayesianism: A Practical Introduction
by nkurz on Saturday August 30, 2014 @11:16PM
(#8248337)
My interpretation? If not clear, I'm quoting the penultimate paragraph of the last post in the series, right before he thanks the reader for making it to the end: http://jakevdp.github.io/blog/2014/06/12/frequentism-and-bay...
Re:Frequentism and Bayesianism: A Practical Introduction
by Houshalter on Saturday August 30, 2014 @11:34PM
(#8248363)
Yes frequentism is common in science and the author strongly objects to it. Read the whole post:
https://jakevdp.github.io/blog/2014/06/12/frequentism-and-ba...
<spoiler>
The moral of the story is that frequentism and Science do not mix. Let me say it directly: you should be suspicious of the use of frequentist confidence intervals and p-values in science. In a scientific setting, confidence intervals, and closely-related p-values, provide the correct answer to the wrong question. In particular, if you ever find someone stating or implying that a 95% confidence interval is 95% certain to contain a parameter of interest, do not trust their interpretation or their results. If you happen to be peer-reviewing the paper, reject it. Their data do not back-up their conclusion.
</spoiler>