News for hackers. Stuff that matters.
Re:It’s not just p=0.048 vs. p=0.052 by BeetleB on Wednesday September 11, 2019 @11:22AM (#20941102)
>If you run 1000 experiments over the course of your career, and you get a significant effect (p < .05) in 95 of those experiments

I'm all for criticism of p-values, but when I read a lot of critiques, I get to this point and simply stop reading.

No statistics text book that I've read assigns the magic value of p=0.05 and labels it as significant. All the ones I've read tell you to pick a p-value appropriate to your experiment. Yes, I get it that many social scientists don't have much of a clue and use 0.05 as some special threshold, but let's direct the criticism to the guilty parties, instead of blaming a statistical methodology.

I mean, we all know people who misuse the mean ("the average number of breasts a person has is 1") and ignore the shape of the distribution and the standard deviation. Yet we don't say "Let's stop using the mean!"

There are no comments on this comment yet.