News for hackers. Stuff that matters.
Re:Major AI conference flooded with peer reviews written by AI by maxspero on Saturday November 29, 2025 @01:38PM (#46089717)
There are dozens of first generation AI detectors and they all suck. I'm not going to defend them. Most of them use perplexity based methods, which is a decent separators of AI and human text (80-90%) but has flaws that can't be overcome and high FPRs on ESL text.

https://www.pangram.com/blog/why-perplexity-and-burstiness-f...

Pangram is fundamentally different technology, it's a large deep learning based model that is trained on hundreds of millions of human and AI examples. Some people see a dozen failed attempts at a problem as proof that the problem is impossible, but I would like to remind you that basically every major and minor technology was preceded by failed attempts.

Re:Major AI conference flooded with peer reviews written by AI by QuadmasterXLII on Saturday November 29, 2025 @02:35PM (#46090128)
Some people see a dozen extremely profitable, extremely destructive attempts at a problem as proof that the problem is not a place for charitable interpretation.
Re:Major AI conference flooded with peer reviews written by AI by wordpad on Saturday November 29, 2025 @03:22PM (#46090434)
And you don't think a dozen of basically scams around the technology justify extreme scepticism?
Re:Major AI conference flooded with peer reviews written by AI by QuadmasterXLII on Saturday November 29, 2025 @03:33PM (#46090534)
huh?
Re:Major AI conference flooded with peer reviews written by AI by anonymouskimmer on Saturday November 29, 2025 @03:31PM (#46090514)
Can your software detect which LLMs most likely generated a text?
Re:Major AI conference flooded with peer reviews written by AI by maxspero on Saturday November 29, 2025 @05:05PM (#46091230)
Pangram is trained on this task as well to add additional signal during training, but it's only ~90% accurate so we don't show the prediction in public-facing results
Re:Major AI conference flooded with peer reviews written by AI by pixl97 on Saturday November 29, 2025 @01:57PM (#46089853)
GAN.. Just feed the output of your algorithms back into the LLM while learning. At the end of the day the problem is impossible, but we're not there yet.