News for hackers. Stuff that matters.
Re:Reproducibility Crisis: The Plot Thickens by mandor on Thursday November 12, 2015 @03:36AM (#10551990)
4. The grant agencies (e.g. the NSF) could use some of its money to pay some labs to reproduce the study during the end-of-grant review process, in the same way as it already pays reviewers and committees for the initial review process. This would add a direct pressure to publish things that are easy to reproduce.

Of course, that would mean even less grants...

5. Each PI should have a single grant at a time (and a long one), to end the "money competition" (that mirrors the publication competition) and spread the grants better.

Re:Reproducibility Crisis: The Plot Thickens by danieltillett on Thursday November 12, 2015 @04:05AM (#10552063)
In regards 4 the basic problem is it is really difficult to reproduce work. If an experiment does not work is it because the original paper was wrong, or is it because you are just not doing things correctly? The person best able to ensure everything is correct is the original investigator provided they have the time. This is what we need to fix.

If we were to move to a lottery process then there would be no need to limit anyone.