Re:OpenAI Quietly Shuts Down Its AI Detection Tool
by ImprobableTruth on Tuesday July 25, 2023 @12:20PM
(#36864736)
Flagged "human" but actually "LLM" is not a false positive, but a false negative.
[ Parent
| on HN ]
Re:OpenAI Quietly Shuts Down Its AI Detection Tool
by WillPostForFood on Tuesday July 25, 2023 @02:42PM
(#36867339)
It depends how the question is framed: are you asking to confirm humanity, or confirm LLM.
If you are asking, is this LLM text Human generated, and it says Human (yes), then it is false positive.
If you are asking is this LLM generated text LLM generated, and is says and it says Human (no), then it is a false negative.
Re:OpenAI Quietly Shuts Down Its AI Detection Tool
by NoZebra120vClip on Wednesday July 26, 2023 @12:26AM
(#36873085)
That seems like a restrictive binary. Are there not other entities which generate text? What if a gorilla uses ASL that is transcribed? ELIZA could generate text, after a fashion, as a precursor to LLM. It seems like there's a number of automated processes that could take data and generate text, sort of, like weather reports, no?
So I think the only thing a mythical detector could determine would be LLM, or non-LLM, and let us take it from there. But detectors are bunk; I've had first-hand experience with that.