News for hackers. Stuff that matters.
Re:Reproducibility Crisis: The Plot Thickens by ars on Thursday November 12, 2015 @02:24AM (#10551777)
> We have created a system where the pressure to publish first and ask questions later is totally overwhelming.

Why can't people simply publish negative results?

> Break the link between publication and grant funding.

Same answer - in fact give extra priority to those who publish lots of negative results.

Re:Reproducibility Crisis: The Plot Thickens by IshKebab on Thursday November 12, 2015 @03:14AM (#10551917)
> Why can't people simply publish negative results?

Mainly because it's not as interesting. For every positive result researchers find there are dozens of things they test that just don't work.

Imagine if the first test of "romantic priming" didn't work. Would the researchers really bother trying to publish "Hypothesised romantic priming effect was just a wild hunch after all."? And would the journal accept it? No way.

Of course if you get a negative effect for an established "fact", as in this case it can be published. But you have to be really really sure otherwise the reviewers will just say you did your experiment wrong.

Re:Reproducibility Crisis: The Plot Thickens by iamsohungry on Thursday November 12, 2015 @06:18AM (#10552478)
> Mainly because it's not as interesting. For every positive result researchers find there are dozens of things they test that just don't work.

That seems to be the core of the problem. Reality doesn't have a bias toward results that are interesting, humans do.

> Imagine if the first test of "romantic priming" didn't work. Would the researchers really bother trying to publish "Hypothesised romantic priming effect was just a wild hunch after all."? And would the journal accept it? No way.

So maybe they should.

Re:Reproducibility Crisis: The Plot Thickens by adrianN on Thursday November 12, 2015 @03:05AM (#10551888)
Because negative results are a dime a dozen. If you want to publish a negative result you have to do a lot more work to convince your peers that the thing you did was actually interesting. It's hard enough to do that with papers that show a real effect, scientists tend to be rather dismissive of other's work.
Re:Reproducibility Crisis: The Plot Thickens by stkni on Thursday November 12, 2015 @02:47AM (#10551832)
>> Why can't people simply publish negative results?

The journal's peer review process tends to reject them. Or so I'm told by a researcher friend of mine.

Re:Reproducibility Crisis: The Plot Thickens by mandor on Thursday November 12, 2015 @03:31AM (#10551973)
> Why can't people simply publish negative results?

In addition to the other comments: because a negative result is usually much more likely than a negative one, it is very hard to be sure that the experimenter did not simply screw up the experiment.

Re:Reproducibility Crisis: The Plot Thickens by omginternets on Thursday November 12, 2015 @05:27AM (#10552294)
In principle there's no reason why they couldn't or shouln't. In practice, however, this leads to a non-trivial increase in the signal-to-noise ratio in academic journals.
Re:Reproducibility Crisis: The Plot Thickens by varjag on Thursday November 12, 2015 @03:41AM (#10552001)
Proving a negative rigorously is just as hard as proving a positive.

A lack of positive proof generally does not constitute a negative proof.