Re:Spotting LLMs with Binoculars: Zero-Shot Detection of Mac...
by GuB-42 on Tuesday January 23, 2024 @08:19PM
(#39112413)
It is what you get when you ask ChatGPT for the US constitution, so yeah, AI generated.
This effect is described in the article. And depending on the context, it can be a feature rather than a bug. If you are using an LLM detector to check if a news article or student essay is "legit", then not only you don't want something from a LLM, but you don't want copy-paste plagiarism either. So for the purpose of checking legitimacy of supposedly original work, then it is a desirable kind of false positive.
I suppose simpler techniques can then be use to check for verbatim copies of famous text.
This effect is described in the article. And depending on the context, it can be a feature rather than a bug. If you are using an LLM detector to check if a news article or student essay is "legit", then not only you don't want something from a LLM, but you don't want copy-paste plagiarism either. So for the purpose of checking legitimacy of supposedly original work, then it is a desirable kind of false positive.
I suppose simpler techniques can then be use to check for verbatim copies of famous text.