News for hackers. Stuff that matters.
Re:Supercomputers surprisingly link DNA crosses to cancer by danieltillett on Sunday June 21, 2015 @08:17PM (#9755561)
We certainly undervalue replication (or refutation) in the pursuit of novelty.

What is more of a problem is that scientists are being pushed by the system to get their results out as fast as possible so they are not doing the hard work of carefully checking their own work before publication. The incentive is to publish if an experiment works once or twice and hand-wave away the other dozen times it didn’t. Combine that with the enormous pressure PostDocs and PhD students are under to generate results it is amazing anything of value comes out of the lab these days.

Re:Supercomputers surprisingly link DNA crosses to cancer by Sven7 on Monday June 22, 2015 @02:39AM (#9756566)
The number of people capable of producing good science, is much less than the number of people in science. The pressures emerge because of it.
Re:Supercomputers surprisingly link DNA crosses to cancer by danieltillett on Monday June 22, 2015 @02:55AM (#9756616)
Even the people capable of producing good science are pushed into bad situations. The basic problem is we have more good scientists than the funding to support them - when the success rate of grants is less than 15% then the pressure gets extreme and also sorts of bad behaviour results.

As a bit of an aside grant reviews were apparently brought in initially to help scientists avoid working on bad areas. The idea was that everyone would get funded who put up a reasonable grant and they just wanted to help screen out the bad ideas so people didn’t waste their time.

We have since twisted this into the current system where we try to determine which of the top few percent of grants are the best. Of course the whole ranking process is so noisy that it is little better than chance for anyone in the top 25%.

A much better system would be to rank the grants as worth funding or not and then put all those worth funding into a lottery to choose who gets funded. At least this way even the losers would know they were on the right track and they were just unlucky. It would save an enormous amount of grantmanship and other activities that are the antithesis of everything science should be about.