News for hackers. Stuff that matters.
Re:Jupyter, Mathematica, and the Future of the Research Paper by improbable22 on Sunday April 15, 2018 @09:49AM (#16842611)
Because the reproducibility crisis has very little to do with the difficulty in re-running the same code. These are almost orthogonal concerns.

The typical problem paper has a small data set, on which the authors tried 20 different things, one of which achieved p<0.05 and got published. The result tells you nothing meaningful about the world (or more often, tells you something about how its authors wish the world worked). But re-running their code on their data set will not reveal the problem.

There are no comments on this comment yet.