News for hackers. Stuff that matters.
Re:Why isn't preprint review being adopted? by andyferris on Sunday March 24, 2024 @05:04PM (#39810515)
It might cost $100k - $1m (or more) to repeat the work and run replications. The $5k - $10k mentioned earlier would be enough to allow time reading and thinking and checking some stuff on pen-and-paper.
Re:Why isn't preprint review being adopted? by michaelt on Sunday March 24, 2024 @05:14PM (#39810573)
> The $5k - $10k mentioned earlier would be enough to allow time reading and thinking and checking some stuff on pen-and-paper.

The average postdoc in the US earns $32.81/hour, according to the results of some googling. Even taking overheads into account, $5k should cover more than a week's full time work.

Re:Why isn't preprint review being adopted? by sseagull on Sunday March 24, 2024 @10:08PM (#39812290)
In what area of science would it take only a week or two to replicate?

It might take several days to a week of literature review just to fully understand the problem. Then you might need equipment, chemicals, cultures, etc. Then depending on the area of science, doing the actual experiment could take several weeks (waiting for reactions, computer simulations, etc). Then possibly tricky analysis and statistics on top of that.

Nowadays, science is deep

Re:Why isn't preprint review being adopted? by rhelz on Sunday March 24, 2024 @11:07PM (#39812537)
Science is very deep; I’m sure that to replicate some studies it would cost as much as performing the original study did.

But whether it’s $10k or $100k, we really should provide the funds to do it. Expensive? Yeah, but not as expensive funding grants for generations of psychology professors and getting nothing—or worse than nothing—in return.

Psychology could fix its replication crisis tomorrow if as part of writing every grant, they also calculated what it would take for another group to replicate their experiments, and put that money in escrow to hire reviewers and replicators who had to sign off on any papers published.