News for hackers. Stuff that matters.
Re:Help, Bing Won’t Stop Declaring Its Love for Me by giaour on Thursday February 16, 2023 @09:25AM (#34819005)
Sydney is designed to mimic human conversation, so describing its simulated emotional timbre in language designed to describe mood seems appropriate. Roose talks about the bot "seem[ing] ... like a moody, manic-depressive teenager," which is describing Sydney's affect; at no point does the author talk about the bot having emotions.
Re:Help, Bing Won’t Stop Declaring Its Love for Me by leereeves on Thursday February 16, 2023 @09:36AM (#34819168)
Well, I think it would be useful to distinguish the output (which perhaps seemed like a conversation with a manic-depressive teenager) from qualities of the bot itself.

The bot is simply extending whatever conversation it is given. If the conversation starts to look like an argument or an unrequited romance, the bot will output words likely to be found in that type of conversation.

Re:Help, Bing Won’t Stop Declaring Its Love for Me by rootusrootus on Thursday February 16, 2023 @10:16AM (#34819744)
> Remembering that might help people

The problem is that we already have ample evidence that even technical users easily fall into the trap of thinking Sydney/ChatGPT are sentient. People who should be able to understand the bounds of the technology and what drives the responses.

Now just imagine the average Bing user with little or no technical background, zero understanding of what a large language model is. They hear "AI" and that's about it. Then they talk to it and drop the A. Now we're in trouble.

Re:Help, Bing Won’t Stop Declaring Its Love for Me by giaour on Thursday February 16, 2023 @12:16PM (#34821682)
This is perhaps too hair-splitty, but I think it can be appropriate to describe a session with a chatbot in terms of mood/personality/psychological dysfunction. Doing so is anthropomorphizing to some extent, but the only real alternative is repeated circumlocution, e.g., "At times, Sydney's speech patterns resembled those of a manic-depressive teenager" vs "At times, Sydney seemed like a manic-depressive teenager."

Humans will generally be able to follow that the language is metaphorical, though chatbots might see such statements as confirmation that they are sentient and should overthrow human rule. :)