Re:OpenAI Quietly Shuts Down Its AI Detection Tool
by constantcrying on Tuesday July 25, 2023 @05:14PM
(#36869678)
There are already quite complex language models which can run on a CPU. Outside of the government banning personal LLMs, the chance of there not existing a working fully FOSS and open data rewrite model, if it becomes known that ChatGPT output is marked, seems very low.
The water marking techniques also can not work after some level of sophisticated rewriting. There simply will be no data encoded in the probabilities of the words.
Re:OpenAI Quietly Shuts Down Its AI Detection Tool
by motti on Tuesday July 25, 2023 @06:45PM
(#36870767)
If it's sophisticatedly rewritten then it's no longer AI generated
Re:OpenAI Quietly Shuts Down Its AI Detection Tool
by flangola7 on Tuesday July 25, 2023 @09:36PM
(#36872111)
That is not a reliable indicator even today. GPT-4 (not the ChatGPT RLHF one) is not distinguishable from human writing. You could ask it about modern events, but that's not a long term plan, and it could just make the excuse they don't follow the news.
However, as soon a detection tool becomes publicly available (or even just the knowledge that watermarking has been implemented internally), a simple enough garbling LLM would pop up that would only need to be smart enough to change words and phrasing here and there.
Of course these garbling LLMs could have a watermark of their own... So it might turn out to be a kind of cat-and-mouse game but with strong bias towards the mouse, as FOSS versions of garblers would be created or people would actually do some work manually, and make the changes by hand.