News for hackers. Stuff that matters.
Re:p-Hacking and False Discovery in A/B Testing by danielvf on Sunday July 22, 2018 @12:02AM (#17585225)
“the misuse of data analysis to find patterns in data that can be presented as statistically significant when in fact there is no real underlying effect. This is done by performing many statistical tests on the data and only paying attention to those that come back with significant results, instead of stating a single hypothesis about an underlying effect before the analysis and then conducting a single test for it.“

https://en.m.wikipedia.org/wiki/Data_dredging

And here’s a great example of real life P-Hacking to get a catchy article about the health benefits of chocolate:

https://io9.gizmodo.com/i-fooled-millions-into-thinking-choc...

Re:p-Hacking and False Discovery in A/B Testing by vitus on Sunday July 22, 2018 @12:18AM (#17585256)
FiveThirtyEight actually has a pretty good demo of p-hacking that demonstrates how one underlying dataset can be used to derive any desired conclusion(s) by deciding which factors to include / exclude.

https://projects.fivethirtyeight.com/p-hacking/

Re:p-Hacking and False Discovery in A/B Testing by cryptonector on Sunday July 22, 2018 @02:04AM (#17585477)
Torturing the data until it sings.