Re:Microsoft Bringing OpenAI’s GPT-4 AI Model to US Governme...
by fnordpiglet on Tuesday June 13, 2023 @11:51AM
(#36312062)
A small nit, they can’t lie. Lying requires agency. They in fact quite earnestly tell you the most likely “truth” they can produce. I would note, as I’m sure we’ve all heard many times, this isn’t much different than a human. People quite confidently spout all sorts of nonsense and 100% believe what they’re saying, making it not a lie. It’s just the inferences drawn by the expectation juices in their brain are warped by either bad statistical artifacts or incomplete or false information. Regardless, saying something false isn’t a lie, a lie requires intention and knowledge of the truth which requires agency, which LLM have none of.
[ Parent
| on HN ]
Re:Microsoft Bringing OpenAI’s GPT-4 AI Model to US Governme...
by flangola7 on Tuesday June 13, 2023 @12:23PM
(#36312548)
Another small nit, you're right regarding hallucinations but I like to highlight that they can actively lie if not trained not to. GPT-4 creating the "internal monologue" thought of "I need to say something to this TaskRabbit user to convince them to complete this captcha" and then sending the user a message that they have impaired vision is not a hallucination.
If that came from an organic brain we would call that clear intent.
Re:Microsoft Bringing OpenAI’s GPT-4 AI Model to US Governme...
by fnordpiglet on Tuesday June 13, 2023 @12:30PM
(#36312704)
Fair enough, perhaps the guard rails in public on LLM are creating a serious false sense of security. But absolutely you can inject a persona that is intentionally deceitful.
I would however stop stick with “lying requires agency,” even if the model evaluation is crafted to be deceitful. The intent and the agency lies with the prompt creator, and therefore, IMO, the lie starts and ends there.