News for hackers. Stuff that matters.

A comment on Effect size is significantly more important than statistical significance. Parent comment

Re:Effect size is significantly more important than statisti... by BenoitEssiambre on Tuesday September 14, 2021 @04:09PM (#28530375)
p = 0.0001 doesn't help much. You can get to an arbitrarily small p by just using more data. The problem is trying to reject a zero width null hypothesis. Scientists should always reject something bigger than infinitesimally small so that they are not catching tiny systematic biases in their experiments. There are always small biases.

Gwern's page "Everything Is Correlated" is worth reading: https://www.gwern.net/Everything

[ Parent | on HN ]
Re:Effect size is significantly more important than statisti... by bpodgursky on Tuesday September 14, 2021 @04:14PM (#28530442)
It would at least filter out the social science experiments where results on 30 college students is "significant" at p=.04 (and it's too expensive to recruit 3000 of them to force significance).
[ Parent | on HN ]