News for hackers. Stuff that matters.
Re:Can Peer Review Survive AI-Generated Text? [pdf] by azan_ on Wednesday November 18, 2026 @09:55AM (#50547036)
> Our evaluation not only finds that performance varies wildly across AIGT detectors (e.g., FPRs between 0.05 % and 68.6 % and FNRs ranging between 0.3 % and 99.6 %).

So it appears that there are good detectors that can be used and bad ones that shouldn’t.

Re:Can Peer Review Survive AI-Generated Text? [pdf] by Borealid on Wednesday November 18, 2026 @10:02AM (#50547129)
That set of statistics does not tell you whether there are good detectors or not.

If the low FPR and the low FNR are the same detector, that's good. But it's more likely one detector has a high FNR and a different detector a high FPR, and the texts causing errors may be correlated across detectors making a "best of both worlds" multipass approach difficult or impossible.

Re:Can Peer Review Survive AI-Generated Text? [pdf] by azan_ on Wednesday November 18, 2026 @11:05AM (#50547996)
Low fpr with avg fnr is still very useful.