Re:What it was like to be peer reviewed in the 1860s
by nonbel on Wednesday May 10, 2017 @04:09PM
(#14311192)
I agree that peer review should not be used to detect fraud. I would even say there is no reason to have any method devoted to detecting fraud. Instead just use independent replication to filter out fraudulent, sloppy, and unreliable results.
While I've experienced what you've described, I think throwing it all out is merely going to the other extreme.
I think peer review should remain, but may need reform. The larger problem is the attitude of scientists today - some of the problems you yourself mentioned. Removing peer review will not fix those. And "fixing" peer review to handle those problems is merely treating a symptom. Ultimately, the larger problem is the mentality that has spread amongst academics - and the problems will remain no matter how you tweak peer review.
>In addition to being poor at detecting gross defects and almost useless for detecting fraud
This gets mentioned a lot, so I'll repeat what many others have said: Peer review was never meant to detect fraud, and should not be expected to.
Back during the Schon scandal, people kept asking how peer review had failed the system to let him get so far before he was caught. And the answer was always the same: Peer review is not the appropriate method to catch such people. It was never meant for it.
https://en.wikipedia.org/wiki/Sch%C3%B6n_scandal