News for hackers. Stuff that matters.
Re:An Elaborate Academic-Journal Hoax by blastforses on Wednesday October 03, 2018 @07:05PM (#18135536)
The whole point of a peer review system is to detect fraud. If these bullshit papers got published, who knows how many of the other papers are of equal quality.
Re:An Elaborate Academic-Journal Hoax by TheCoelacanth on Wednesday October 03, 2018 @10:25PM (#18136632)
The point of peer review is to stop bad research, not fake research. The reviewers are supposed to make sure that the methods used to acquire the data are clearly documented and that the conclusions drawn from the data follow from the data that was collected.

They can't verify that the data collected actually was collected without literally watching over the shoulder of the researcher while the researcher was collecting it, which is obviously not feasible. A researcher actively trying to deceive the reviewer with fake data but with a good method for collecting that data and analysis of the data that would be correct if the data were real is not something that should be caught by a reviewer. That should be caught by someone reproducing the research after publication.

Re:An Elaborate Academic-Journal Hoax by pervycreeper on Wednesday October 03, 2018 @11:46PM (#18137010)
>The point of peer review is to stop bad research, not fake research

I would submit that "fake research" is, in fact, bad research.

Re:An Elaborate Academic-Journal Hoax by UncleMeat on Thursday October 04, 2018 @12:33AM (#18137220)
To a reviewer with three hours to spare, fake research is indistinguishable from good research. Unless you want to give me months to review a paper, I will not be able to detect fraud.

Instead I rely on the fact that the community will attempt to integrate these ideas after publication and arrive at the conclusion that the paper was garbage.

Re:An Elaborate Academic-Journal Hoax by malvosenior on Thursday October 04, 2018 @09:38AM (#18139742)
If you only have three hours, can't detect fraud, can't tell if the the paper is even real. Then what's the point of even doing the peer review? Again, peer review offered no value at all in this case.
Re:An Elaborate Academic-Journal Hoax by kd0amg on Friday October 05, 2018 @04:02PM (#18151241)
Peer review can still inspect whether the evidence presented in a paper would—if not fabricated—truly be enough to support the paper's conclusion. Mistaken analysis of honestly collected data, improper experimental methods, flawed proofs, etc. can all show up at review time.
Re:An Elaborate Academic-Journal Hoax by UncleMeat on Thursday October 04, 2018 @12:26PM (#18141335)
You can certainly come to that conclusion if you'd like. Arxiv exists. But "peer review isn't especially usrful" and "these entire fields are nonsense" are very different conclusions.
Re:An Elaborate Academic-Journal Hoax by michaelkeenan on Wednesday October 03, 2018 @11:26PM (#18136920)
Where did you learn that the whole point of peer review is to detect fraud?

The Wikipedia article on peer review says "Peer review...occasionally detects fraud, but is not designed to do so."[1]

The article cites a Nature article that says "Peer review is not currently designed to detect deception, nor does it guarantee the validity of research findings. It should, however, identify flaws in the design, presentation, analysis and interpretation of science and provide prompt, detailed, constructive criticism to improve research."

[1] https://en.wikipedia.org/wiki/Scholarly_peer_review

[2] https://www.nature.com/nature/peerreview/debate/nature05007....