News for hackers. Stuff that matters.
Re:Potential organized fraud in ACM/IEEE computer architectu... by BurningFrog on Monday June 08, 2020 @07:26PM (#23461904)
Seems like Peer Review is hopelessly broken. Conflicts of interest galore.

Science did fine without it until ~40 years ago, and it can do so again. I hope.

Re:Potential organized fraud in ACM/IEEE computer architectu... by mhh__ on Monday June 08, 2020 @07:51PM (#23462113)
The solution is still within peer review, I feel. What ethical alternative is there?

Required reproduction of the result could be a step forward, but only for cheap research.

Re:Potential organized fraud in ACM/IEEE computer architectu... by BurningFrog on Monday June 08, 2020 @08:37PM (#23462392)
I don't think science was unethical before Peer Review.

As I understand it, modern peer review came about as a 'crowd sourcing" solution to the hugely expanding number of articles to publish, in ever more specialized fields.

The journals couldn't keep enough relevant expertise around, so letting the scientists review each other was the simple fix.

Re:Potential organized fraud in ACM/IEEE computer architectu... by throwawayiionqz on Monday June 08, 2020 @11:30PM (#23463391)
This does not make sense.

Before scientists started reviewing each other, who at the journal was judging the work of scientists to be published? Scientists?

Re:Potential organized fraud in ACM/IEEE computer architectu... by BurningFrog on Monday June 08, 2020 @11:45PM (#23463455)
Well, science literate people working at the journal, I assume.

The point is that they did not have a conflict of interest.

In 2020 peer review, people are often asked to review the work of their rivals. So they're incentivized to (1) say that it's bad and demand many changes, and/or (2) steal their ideas.

Re:Potential organized fraud in ACM/IEEE computer architectu... by wegs on Tuesday June 09, 2020 @05:38AM (#23465132)
arxiv and letting good stuff bubble up after-the-fact.

Peer review in my field is a random process. It's not corrupt; it's just that reviewers give papers a 30 second skim. I've had one paper really reviewed in my whole career. What gets in and out is just random. NIPS did a nice study on this many years back.

On the flip side, academic discourse gets delayed. People aim for Science/Nature, and then down the line. Journals / conferences aim for the prestige of high reject rates. Research goes out sometimes years too late.

Peer review gives the impression of credibility, without the reality. It should be gone. Tiers of journals should be gone too.

Re:Potential organized fraud in ACM/IEEE computer architectu... by tnecniv on Monday June 08, 2020 @09:42PM (#23462778)
Peer review is much older than that. It dates back to the 18th century.
Re:Potential organized fraud in ACM/IEEE computer architectu... by BurningFrog on Tuesday June 09, 2020 @09:59AM (#23466693)
Sure, but it didn't become mandatory and institutionalized until fairly recently.