Re:Can Peer Review Survive AI-Generated Text? [pdf]
by mweidner on Wednesday November 18, 2026 @11:16AM
(#50548126)
Peer review serves a few purposes:
1. Verification (is this paper's methods/conclusion valid)
2. Assign academic credit
3. Winnow down the set of all papers enough that a researcher can keep up with the new ones in their field.
This article mostly talks about #1, arguing that AI-generated papers are likely to fail verification while consuming a lot of review time.
However, I'm more interested in #3: as a researcher, how do I (externally) narrow down the new papers/ideas/libraries in my field enough that I can then manually choose what to read? E.g., give me a curated list of abstracts, short enough that I can read all of those abstracts and sub-select papers to read fully.
Peer-reviewed conferences do this by capping the number of accepted submissions (low enough that each paper can reserve ~20 minutes in the same building over several days), but #2 made that difficult even before AI. Unlimited AI-generated papers break the simple filter "looks like a LaTeX paper and matches my keywords", which worked fine for smaller fields.
Filtering out high AI % papers is an easy way to upper bound the number of papers you'll see by `(researchers in your field) * (time per researcher) / (time to write a polished LaTex paper by hand)`.
1. Verification (is this paper's methods/conclusion valid)
2. Assign academic credit
3. Winnow down the set of all papers enough that a researcher can keep up with the new ones in their field.
This article mostly talks about #1, arguing that AI-generated papers are likely to fail verification while consuming a lot of review time.
However, I'm more interested in #3: as a researcher, how do I (externally) narrow down the new papers/ideas/libraries in my field enough that I can then manually choose what to read? E.g., give me a curated list of abstracts, short enough that I can read all of those abstracts and sub-select papers to read fully.
Peer-reviewed conferences do this by capping the number of accepted submissions (low enough that each paper can reserve ~20 minutes in the same building over several days), but #2 made that difficult even before AI. Unlimited AI-generated papers break the simple filter "looks like a LaTeX paper and matches my keywords", which worked fine for smaller fields.
Filtering out high AI % papers is an easy way to upper bound the number of papers you'll see by `(researchers in your field) * (time per researcher) / (time to write a polished LaTex paper by hand)`.