News for hackers. Stuff that matters.
Re:Why Most Published Research Findings Are False (2005) by glofish on Wednesday October 19, 2022 @03:27PM (#33266778)
This followup paper seems to summarize p-values reported in 77K papers and uses the distribution of these p-values to compute the FDR.

Alas everyone knows that the p-values reported in accepted (!) papers are questionable at best - any analysis that uses them is on shaky foundation.

The misuse of p-values in science is well known and an endemic problem - so what do we learn from a re-analysis of made up numbers?

Re:Why Most Published Research Findings Are False (2005) by Manu40 on Wednesday October 19, 2022 @04:17PM (#33267429)
Not to be pedantic, but considering how many people I have run into who take all research studies as if they are holy gospel; you may want to reconsider saying "everyone knows".

Just my 5 cents on the matter.

Re:Why Most Published Research Findings Are False (2005) by glofish on Wednesday October 19, 2022 @05:49PM (#33268315)
good point, what I really meant is

by now everybody should know that p-values are questionable at best

Re:Why Most Published Research Findings Are False (2005) by genewitch on Wednesday October 19, 2022 @10:50PM (#33270282)
can we name one mainstream journalist, or any policy makers that know anything about reproducibility - or, more honestly, the appalling lack thereof - or "p-values are questionable at best"?

There's been books, such as "how to lie with statistics" that should be mandatory reading, at least on entry to adulthood. I am one of maybe 3 people i know personally that knows how to actually parse a scientific paper, so when someone starts throwing a half dozen studies at me to back up their point, i can usually - on the scale of quarter hours - nitpick their understanding of the sources they used.

This doesn't win anyone friends, and something i've said for nearly 3 decades: Religion and science like to point fingers, but religion seems more likely to bend and change than science. Every time i mention this or an analogue i'm shouted at that it's "actually the opposite".

Shut up already, it's science. The science is in. This is science!

Re:Why Most Published Research Findings Are False (2005) by Manu40 on Thursday October 20, 2022 @01:08AM (#33271034)
One of my old science teachers said to our class in grade 9:

"Science is the profession of finding out everything wrong about your assumption first, before finally figuring out what is right."

He wouldn't be too popular with some people today, I can tell ya that much.