News for hackers. Stuff that matters.
Re:Survey of scientists sheds light on reproducibility crisi... by staticautomatic on Sunday January 05, 2020 @06:35PM (#21965065)
I bet a lot would change if the largest funding institutions publicly prioritized funding scientists who have a history of publishing reproducible work.
Re:Survey of scientists sheds light on reproducibility crisi... by keldaris on Sunday January 05, 2020 @07:19PM (#21965338)
Sure - for some definition of "reproducible". Any metric you come up with that's easily measurable will be gamed into oblivion. Anything meaningful - like looking at dedicated reproduction studies, etc. - requires a complete change in how academia functions, because right now publishing a paper that just aims to reproduce (or fail to) a previous work is effectively impossible in most fields. Not to mention that given the incentive structure you'd be pretty crazy to even try.
Re:Survey of scientists sheds light on reproducibility crisi... by staticautomatic on Sunday January 05, 2020 @07:30PM (#21965402)
It may well be some kind of law that every positive incentive creates at least one perverse incentive, but that doesn't mean positive incentives don't work or aren't worth trying.
Re:Survey of scientists sheds light on reproducibility crisi... by lettergram on Sunday January 05, 2020 @09:42PM (#21965993)
I tend to argue that 10%-20% of a grant should go to reproducibility. This does two things:

1. It would help fund / ensure funding to several labs in the space.

2. It would help ensure reproducibility of results

Yes, it can be gamed, but generally it should be easier to reproduce results so 10%-20% of the funding to follow directions should be okay. Of course, this could lead to one group just constantly doctoring results to show something is not reproducible. In which case, a third lab would need to get some funding to check it out.

Re:Survey of scientists sheds light on reproducibility crisi... by Fomite on Sunday January 05, 2020 @08:01PM (#21965556)
First they'd have to fund the reproducibility studies.
Re:Survey of scientists sheds light on reproducibility crisi... by taneq on Sunday January 05, 2020 @08:47PM (#21965767)
Well they shouldn’t have any trouble funding the first one...
Re:Survey of scientists sheds light on reproducibility crisi... by Fomite on Sunday January 05, 2020 @10:38PM (#21966234)
They have plenty of trouble funding much of anything.