News for hackers. Stuff that matters.
Re:Science Fraud Site Owner Suspends Site in Response to Leg... by ams6110 on Saturday January 05, 2013 @01:34PM (#5013494)
Isn't the need for a site like this suggesting that "peer review" is not working anymore for some reason? Why is that?
Re:Science Fraud Site Owner Suspends Site in Response to Leg... by tzs on Saturday January 05, 2013 @03:47PM (#5013998)
Scientific fraud is usually in things that aren't normally checked by peer review. For instance, suppose someone writes a fraudulent paper showing that broccoli leads to homosexuality.

The peer reviewers will be looking at the design of his experiment--could it actually show such a link, and does it control for other factors that might explain the result? Does the paper give enough detail for others to repeat the experiment? Is the analysis of the data sound statistically? Is the work original? Is it citing appropriate prior researchers?

Even in a fraudulent paper, those aspects of the paper should be OK. The fraud will generally be in lying about the results of running the experiment, which is beyond the scope of peer review.

Where that gets caught is after the paper is published, and other researchers try to replicate it and get different results.

Re:Science Fraud Site Owner Suspends Site in Response to Leg... by east2west on Saturday January 05, 2013 @07:11PM (#5014629)
Well, considering that Amgen could only reproduce 11% of "landmark" papers in cancer research, peer review is missing a lot. See "Drug development: Raise standards for preclinical cancer research" http://www.nature.com/nature/journal/v483/n7391/full/483531a...

And some of the scientists insisted on non-disclosure agreement before agreeing to help Amgen reproduce published results, which proves most papers don't publish nearly enough details to reproduce main results.

Peer review is a social organization that necessarily never lives up to its ideals. At top journals such as Science, Nature, Cell, editors also consider PR values, popularity of topics, exclusivity. It is standard practice to obtain prior favorable impression by contacting editors before formally submitting manuscripts at these places. There are different standards of peer review; consortium such as ENCODE and TCGA have a different track for their papers.