News for hackers. Stuff that matters.

A comment on Surges of cosmic radiation from space directly linked to earthquakes. Parent comment

Re:Surges of cosmic radiation from space directly linked to ... by DangerousPie on Friday June 16, 2023 @02:11PM (#36361129)
It's fine if they account for the number of tests they have made when they calculate their significance levels. If they just kept on trying different options until they ended up with p < 0.05 it's almost guaranteed to be noise.
[ Parent | on HN ]
Re:Surges of cosmic radiation from space directly linked to ... by ordu on Friday June 16, 2023 @02:44PM (#36361728)
They used p<0.001. It is not social sciences, there anti-noise filters are stricter.
[ Parent | on HN ]
Re:Surges of cosmic radiation from space directly linked to ... by elcritch on Friday June 16, 2023 @05:04PM (#36363854)
Ah that's not too bad. Though to be fair you also need the data size. That's only what one in a 1k chance (or is it 10k? Too lazy to count it out). If their dataset is small or they automated testing cofactors there's still a decent chance of false probability.
[ Parent | on HN ]