News for hackers. Stuff that matters.
Re:I tried to report scientific misconduct. How did it go? by realradicalwash on Wednesday January 27, 2021 @05:52AM (#25926634)
We are dealing with 5+ papers that are fraudulent and another 5+ newer papers that are most likely fraudulent, too. That is, there have been 20, 25+ reviewers looking at those papers. Their job was to carefully read them and double check the numbers. All of them gave those papers a pass. I am at a loss here.

The authors' behaviour is outrageous, but this story is also about a broken reviewing process, partly due to wrong incentives.

Re:I tried to report scientific misconduct. How did it go? by roel_v on Wednesday January 27, 2021 @09:07AM (#25928397)
"Peer review" is not "have someone else re-do the experiment". That's just not feasible, especially since reviews are done without pay. It's not realistic to expect people to spend more than a few hours reviewing a paper. That amount of time is barely enough to check for overall conceptual issues and maybe flag some really glaring deficiencies. (And then conclude with 'accepted with minor revisions', those 'revisions' preferably being 'add these three citations to my paper, that'll push your paper into 'acceptable' territory'.)
Re:I tried to report scientific misconduct. How did it go? by driverdan on Wednesday January 27, 2021 @10:37AM (#25929470)
But there were glaring deficiencies in the stats. Anyone reviewing the papers should have caught them.
Re:I tried to report scientific misconduct. How did it go? by roel_v on Wednesday January 27, 2021 @11:49AM (#25930434)
Well yeah in the papers of the OP maybe, I don't know. I more meant to address several commentors in this thread that seem to think in general that peer review is 'redo the research' and/or 'validate that it's correct'. It's not.

Nowadays when you see articles results of new research of covid19 in the media, those articles often include 'hasn't been peer reviewed yet' or 'reviewed by other scientists' or any such verbiage, either as a disclaimer or as 'now it must be true'. But that's not how it works; it's not because something has been 'peer reviewed' that it's 'The Truth' or 'Real Science'. Peer review, in reality, just weeds out (most) quacks (although in the OP's case it seems it didn't even do that) and checks that the paper is not completely out of touch with what is happening in and known about the field. It's not QA of the work itself.

(I don't care to debate if it should be, and if more money should be spend on replication etc, just providing some real world context on something that is quite opaque to and often misunderstood by those not in academia)

Re:I tried to report scientific misconduct. How did it go? by remus on Wednesday January 27, 2021 @06:18AM (#25926850)
> Their job was to carefully read them and double check the numbers.

That's the theory. The reality is that there is no in-depth review. You're lucky if a reviewer actually reads the paper all the way through, let alone checks the numbers and applies a level of critical thought to the methodology, analysis and conclusions.

Re:I tried to report scientific misconduct. How did it go? by rapht on Wednesday January 27, 2021 @06:12AM (#25926794)
^ This exactly!

"Peer-reviewed" by whom?...

Re:I tried to report scientific misconduct. How did it go? by chalst on Wednesday January 27, 2021 @11:14AM (#25930011)
Journals typically list their referees per issue, but they do not say who reviewed which paper.