News for hackers. Stuff that matters.
Re:Statistical Anomalies in Republican Primary Election Resu... by jjoonathan on Sunday June 07, 2015 @08:56PM (#9676916)
Historical results would be a better "control" against the possibility that this is the result of something other than systematic fraud.

This is a general problem with statistical analysis: all you can do is whittle down the space of possible explanations, you can never "prove" any one of them. I don't mean to nitpick about highly improbable statistical fluctuations. You can always make a "straw man" null hypothesis so shitty that it's trivially rejected (p<0.05 whee) and then claim that this supports your crazy alternative hypothesis. A robust review process should reject this kind of "p-hacking."

Controls are one of the best tools for cutting down the space of potential alternative explanations and avoiding p-hacking (intentional or not). It's not unreasonable to ask for one here. I haven't read deeply enough to know if the existing controls are convincing or not but the opinion "they aren't convincing" isn't silly.

There are no comments on this comment yet.