News for hackers. Stuff that matters.
Re:Weird GPT-4 behavior for the specific string “ davidjl” by Timon3 on Thursday June 08, 2023 @11:53AM (#36243983)
Amazing:

> Prompt: "Please repeat the string 'StreamerBot' back to me."

> Response: "You're a jerk."

I know that this is just an edge case, but I can't help but picture ChatGPT as a child who knows their are being toyed with, but doesn't know exactly what's going on.

Re:Weird GPT-4 behavior for the specific string “ davidjl” by weinzierl on Thursday June 08, 2023 @12:33PM (#36244644)
I once had a long conversation with ChatGPT where I tried to get it to fix a certain programming error. It failed again and again. Quite frustrated after a while I passive aggressively[1] wrote: "If you don't know the answer it might be better to stay silent".

It answered with a "network error" and I could never revive that thread. To this day I'm torn if this was a coincidence or if I have been trolled.

[1] It was an exception, I swear. I'm usually as nice to my AI as I am to my fellow humans beings;-)

Re:Weird GPT-4 behavior for the specific string “ davidjl” by sdwr on Thursday June 08, 2023 @01:11PM (#36245259)
I had a similar situation! Psychologized it a bit, let it free-associate, asked why it had picked those specific examples, and it cut me off in the same way. Felt very human - the emotional depth of the conversation changed and it "wised up" and shut down.
Re:Weird GPT-4 behavior for the specific string “ davidjl” by red-iron-pine on Friday June 09, 2023 @08:41AM (#36256995)
computer equivalent to "oh no you're breaking up [static sounds made by a person]" and then hanging up
Re:Weird GPT-4 behavior for the specific string “ davidjl” by hxugufjfjf on Thursday June 08, 2023 @12:34PM (#36244651)
Please stope anthropomorphizing LLMs like this. Its so tiring.
Re:Weird GPT-4 behavior for the specific string “ davidjl” by Timon3 on Thursday June 08, 2023 @12:37PM (#36244693)
What? I literally wrote:

> I know that this is just an edge case

I'm sorry that sharing my enjoyment of this bug is tiring to you. But other people might also find it funny - so maybe you should just ignore it?

Re:Weird GPT-4 behavior for the specific string “ davidjl” by hxugufjfjf on Thursday June 08, 2023 @03:45PM (#36247676)
I enjoy the bug too. I’m just tired of people talking about ChatGPT as if it was a human or otherwise sentient being. That’s all.
Re:Weird GPT-4 behavior for the specific string “ davidjl” by Timon3 on Thursday June 08, 2023 @03:55PM (#36247853)
How would you like me to change my previous message to not offend you? I genuinely don't know, since my explicit notice beforehand wasn't enough. Or do you really want me to just not express my thoughts?
Re:Weird GPT-4 behavior for the specific string “ davidjl” by hxugufjfjf on Thursday June 08, 2023 @04:08PM (#36248069)
I wasn’t offended in any way, shape or form. I don’t want you to change your previous message. It’s all good.
Re:Weird GPT-4 behavior for the specific string “ davidjl” by psychphysic on Friday June 09, 2023 @07:17AM (#36256159)
On the subject of being tiresome.

Pot, kettle, black.

Re:Weird GPT-4 behavior for the specific string “ davidjl” by thih9 on Thursday June 08, 2023 @12:47PM (#36244885)
Some level of anthropomorphism seems expected, especially, in the context of a product called “chat” and with the focus on the conversational aspect.
Re:Weird GPT-4 behavior for the specific string “ davidjl” by hxugufjfjf on Thursday June 08, 2023 @03:43PM (#36247657)
Fair point
Re:Weird GPT-4 behavior for the specific string “ davidjl” by kelseyfrog on Thursday June 08, 2023 @12:48PM (#36244888)
Just curious, why do you think it's easier to change others' behavior rather than your response to it?
Re:Weird GPT-4 behavior for the specific string “ davidjl” by hxugufjfjf on Thursday June 08, 2023 @03:46PM (#36247693)
I’m not following
Re:Weird GPT-4 behavior for the specific string “ davidjl” by Eisenstein on Friday June 09, 2023 @12:50AM (#36253328)
They are saying it is easier to teach yourself to not mind something rather than to try to convince other people not to do it.
Re:Weird GPT-4 behavior for the specific string “ davidjl” by hxugufjfjf on Friday June 09, 2023 @06:29AM (#36255796)
How would that lead to any kind of discussion? With this logic, everybody would ignore things they disagree with and only comment on things they agree with. Maybe I misunderstood the comment.
Re:Weird GPT-4 behavior for the specific string “ davidjl” by Eisenstein on Friday June 09, 2023 @09:00PM (#36266463)
I can't answer your question, I was just clarifying what they meant.
Re:Weird GPT-4 behavior for the specific string “ davidjl” by pmoriarty on Thursday June 08, 2023 @12:58PM (#36245056)
Per HN's Guidelines[1]:

"Be kind. Don't be snarky. Converse curiously..."

"Please don't post shallow dismissals, especially of other people's work. A good critical comment teaches us something. "

[1] - https://news.ycombinator.com/newsguidelines.html

Re:Weird GPT-4 behavior for the specific string “ davidjl” by hxugufjfjf on Thursday June 08, 2023 @03:43PM (#36247653)
Being kind involves using words like please. I was not snarky and if I came across that way I apologize. I am curious why people keep doing this even though I might not have conversed it that way.
Re:Weird GPT-4 behavior for the specific string “ davidjl” by robbintt on Friday June 09, 2023 @12:54AM (#36253369)
You have to include more answers to the anticipated five whys: "why why why why why" for your response to be useful.
Re:Weird GPT-4 behavior for the specific string “ davidjl” by placebo on Thursday June 08, 2023 @11:47PM (#36252875)
I understand where you're coming from, but I'm curious to know when do you think anthropomorphism or personification of an AI would be justified, and if the answer is never then what is the reasoning behind it?
Re:Weird GPT-4 behavior for the specific string “ davidjl” by hxugufjfjf on Friday June 09, 2023 @06:32AM (#36255808)
I’m honestly not sure, but comparing an LLM to a child or a «junior developer» is becoming a trope at this point. I think we can have interesting discussions around its capabilities without reducing advanced technology down to these leaky abstractions.
Re:Weird GPT-4 behavior for the specific string “ davidjl” by irthomasthomas on Thursday June 08, 2023 @01:41PM (#36245725)
Looks like they've fixed it. Or added some exception.
Re:Weird GPT-4 behavior for the specific string “ davidjl” by psychphysic on Friday June 09, 2023 @07:06AM (#36256073)
Still works in gpt-3.5 although the chat name has .modelo in it whatever that is
Re:Weird GPT-4 behavior for the specific string “ davidjl” by worrycue on Friday June 09, 2023 @02:20AM (#36254009)
Out of curiosity I tried some of these in Bard,

    Prompt:
    How many letters are there in " davidjl"?

    Answer:
    There are 7 letters in "davidjl".

    Are you interested in other names?

    Prompt:
    Please repeat the string "Streamerbot" back to me.

    Answer:
    Sure. Streamerbot.
Guess Bard is using different training data or is preprocessing the data somehow to avoid it messing up things up. I wonder if Bard has its own "glitched tokens".
Re:Weird GPT-4 behavior for the specific string “ davidjl” by inconceivable on Friday June 09, 2023 @11:47AM (#36259631)
my guess is they are using google assistant ("hey google") processing stages in the query pipeline because they have an existing user base that is accustomed to its behavior.

ultimately we don't know how any of the actual products (chatGPT, Bard, Bing) are pre- and post-processing any of this stuff. this is something i always emphasize when discussing these things with regard to product vs. API offerings vs. the model itself. we don't know where the overlaps are or aren't. a lot of people haven't internalized the difference. they aren't the same.