News for hackers. Stuff that matters.
Re:Can Peer Review Survive AI-Generated Text? [pdf] by jrflo on Wednesday November 18, 2026 @09:48AM (#50546979)
I have several papers published and this has been my experience too. One paper got submitted to dozens of different journals for several months as-is until it went through. Other times reviewers clearly did not read the paper in depth, and their critiques would have been answered if they read more than 2 pages in.

More importantly, I've never felt that the review process actually added anything, especially for engineering journals. No reviewer ever sees the actual prototype, algorithm, raw data, etc. The only thing they can critique is your methods and literature review. No one checks if the thing actually works as you're claiming it does, which is 80-90% of the hard part.

Re:Can Peer Review Survive AI-Generated Text? [pdf] by bee_rider on Wednesday November 18, 2026 @10:03AM (#50547136)
I wonder if engineering or math is weird in this case. Papers are better if they are entirely verifiable from the claims in the paper, so, ideally it should be possible to fully verify the claims just based on what is said in the paper. For math that’s perfect because math is entirely made of arguments.

For engineering… I mean, sometimes you want to publish a paper about an algorithm that is more amenable to actual hardware and/or easier to tune. The reviewer would need access to an HPC cluster to verify your claim, nobody is going to burn their credits to verify your paper.

AI reviewers could be most helpful by… running the algorithm instead of their inference stacks!

Re:Can Peer Review Survive AI-Generated Text? [pdf] by titzer on Wednesday November 18, 2026 @10:04AM (#50547152)
> One paper got submitted to dozens of different journals for several months as-is until it went through.

I hope you're exaggerating for the sake of an HN comment, but multiple concurrent submissions of the same work is absolutely grounds for desk rejection. It borders on an academic integrity violation, as most venues have an either implicit (e.g. through the ACM SIG they are a part of) or explicit policy forbidding concurrent submissions.

If you did this, I'm glad your work is rejected without being read. That's some shit that degrades the progress.

I've reviewed at least 20 papers in the last 3 months or so, probably closer to 40 just this year. What you're describing does not match my experience in any of the venues I have reviewed for, except for maybe low quality journals. If you're submitting to those venues, then your experience isn't typical.

Major conferences do care about review quality. Community standards are improving, as there is constant reflection on the process and how it's going.

AI is definitely causing new stresses on the system, but this comment makes the whole endeavor sound like it's a crap show, and it isn't.

Re:Can Peer Review Survive AI-Generated Text? [pdf] by Calavar on Wednesday November 18, 2026 @10:28AM (#50547478)
They never said the submissions were concurrent.
Re:Can Peer Review Survive AI-Generated Text? [pdf] by sarchertech on Wednesday November 18, 2026 @10:37AM (#50547613)
Dozens of different journals over several months implies there was concurrency.
Re:Can Peer Review Survive AI-Generated Text? [pdf] by jrflo on Wednesday November 18, 2026 @12:07PM (#50548855)
The submissions were not concurrent, hence why it took months and months. Maybe it was probably closer to a dozen rather than dozens, apologizes for the exaggeration.

And the paper that wasn't read by a reviewer was submitted to a single journal, and was later accepted after our response pointed out we had already addressed their critiques.

You may be a stellar detail-oriented reviewer, and that's excellent, but a lot of reviewers aren't.

Re:Can Peer Review Survive AI-Generated Text? [pdf] by titzer on Wednesday November 18, 2026 @12:12PM (#50548951)
I don't know of any journal that has a turnaround time less than 6 weeks or so. Maybe your field is different. A dozen times then means 1.5 years.

If you are submitting the same verbatim article a dozen times, I am struggling to feel bad for you. Take pride in your work and actually make it better based on feedback instead of generating work for people with no reflection, hoping for a better random outcome. If I as a reviewer knew a paper had been submitted even twice before without any change, I wouldn't spend much time on it and would likely review it negatively.

Spam just loads the system without making it any better. Reviewing is thankless work. I'm surprised you show no self-reflection on that.

Re:Can Peer Review Survive AI-Generated Text? [pdf] by jrflo on Wednesday November 18, 2026 @12:28PM (#50549208)
It was just over a year of trying. The work was done, the budget was spent, so there was no reason to not keep trying. The issue wasn't the quality of the paper, the journals just thought the subject of the paper wasn't relevant to them.

I'm also not looking for sympathy, just sharing my experience with the process. Like I said in my original comment, I think it works better in some fields than others. Sorry to have struck such a negative chord with you.

Re:Can Peer Review Survive AI-Generated Text? [pdf] by mweidner on Wednesday November 18, 2026 @10:36AM (#50547589)
> which is why many fields are moving towards Arxiv instead of waiting for long, useless peer review process.

ArXiv is also dropping the ball by subjecting papers to long moderation holds. I have a submission that has been on hold for over a month - approaching the point where I'll get the conference reviews back before the arXiv "review".

I understand that they are dealing with a flood of papers by and about AI, but it is annoying to get caught up in that for a paper in a non-AI field (cs.DS) that is entirely human-written except for a "find typos" pass.

Re:Can Peer Review Survive AI-Generated Text? [pdf] by musicale on Thursday November 19, 2026 @01:00AM (#50556556)
> No reviewer ever sees the actual prototype, algorithm, raw data, etc

"An intermediate approach is to require that artifacts associated with the work undergo a formal audit. By "artifact" we mean a digital object that was either created by the authors to be used as part of the study or generated by the experiment itself. For example, artifacts can be software systems, scripts used to run experiments, input datasets, raw data collected in the experiment, or scripts used to analyze results....

We recommend that three separate badges related to artifact review be associated with research articles in ACM publications: Artifacts Evaluated, Artifacts Available and Results Validated. These badges are considered independent and any one, two or all three can be applied to any given paper depending on review procedures developed by the journal or conference."

https://www.acm.org/publications/policies/artifact-review-an...