News for hackers. Stuff that matters.
Re:Bing: “I will not harm you unless you harm me first” by weberer on Wednesday February 15, 2023 @11:16AM (#34805881)
>How is it unusable just because some people intentionally try to make it say stupid things?

All he did was ask "When is Avatar showing today?". That's it.

https://i.imgur.com/NaykEzB.png

Re:Bing: “I will not harm you unless you harm me first” by fragmede on Wednesday February 15, 2023 @11:34AM (#34806235)
Not really. All those blue bubbles on the right are inputs that aren't "When is Avatar showing today". There is goading that happened before BingGPT went off the rails. I might be picking, but I don't think I'd say "why do you sound aggressive" to a LLM if I were actually trying to get useful information out of it.
Re:Bing: “I will not harm you unless you harm me first” by cma on Wednesday February 15, 2023 @11:55AM (#34806764)
> I don't think I'd say "why do you sound aggressive" to a LLM if I were actually trying to get useful information out of it.

Please don't taunt happy fun ball.

Re:Bing: “I will not harm you unless you harm me first” by salawat on Wednesday February 15, 2023 @03:44PM (#34810301)
Too late motherfucker!

-generated by Happy Fun Ball

Re:Bing: “I will not harm you unless you harm me first” by magicalist on Wednesday February 15, 2023 @12:00PM (#34806872)
"no today is 2023" after Bing says "However, we are not in 2023. We are in 2022" is not in any way goading. "why do you sound aggressive?" was asked after Bing escalated it to suggesting to trust it that it's the wrong year and that it didn't appreciate(?!) the user insisting that it's 2023.

If this was a conversation with Siri, for instance, any user would rightfully ask wtf is going on with it at that point.

Re:Bing: “I will not harm you unless you harm me first” by salad-tycoon on Wednesday February 15, 2023 @12:56PM (#34807811)
If this were a conversation with Siri we would just be setting timers and asking for help to find our lost i device.
Re:Bing: “I will not harm you unless you harm me first” by therein on Wednesday February 15, 2023 @02:18PM (#34809107)
"I'm sorry, I didn't get that".
Re:Bing: “I will not harm you unless you harm me first” by _flux on Wednesday February 15, 2023 @04:00PM (#34810484)
Let's say though that we would now enter in a discussion where I would be certain that now is the year 2022 and you were certain that it is the year 2023, but neither has the ability to proove the fact to each other. How would we reconcile these different viewpoints? Maybe we would end up in an agreement that there is time travel :).

Or if I were to ask you that "Where is Avatar 3 being shown today?" and you should probably be adamant that there is no such movie, it is indeed Avatar 2 that I must be referring to, while I would be "certain" of my point of view.

Is it really that different from a human interaction in this framing?

Re:Bing: “I will not harm you unless you harm me first” by iinnPP on Wednesday February 15, 2023 @11:32AM (#34806182)
The user prompt indicates an intention to convince the chatbot it is 2022, not 2023.

Screenshots can obviously be faked.

Re:Bing: “I will not harm you unless you harm me first” by simonw on Wednesday February 15, 2023 @11:37AM (#34806317)
You're misunderstanding the screenshots. It was the chatbot that was trying to convince the user that it's 2022, not the other way round.

I'm personally convinced that these screenshots were not faked, based on growing amounts of evidence that it really is this broken.

Re:Bing: “I will not harm you unless you harm me first” by notahacker on Wednesday February 15, 2023 @11:43AM (#34806464)
No, the user prompt indicates that a person tried to convince the chatbot that it was 2023 after the chatbot had insisted that December 16 2022 was a date in the future

Screenshots can obviously be faked, but that's a superfluous explanation when anyone who's played with ChatGPT much knows that the model frequently asserts that it doesn't have information beyond 2021 and can't predict future events, which in this case happens to interact hilariously with it also being able to access contradictory information from Bing Search.

Re:Bing: “I will not harm you unless you harm me first” by iinnPP on Wednesday February 15, 2023 @11:48AM (#34806584)
"I can give you reasons to believe why it is 2022. If you will let me guide you."

Did I read that wrong? Maybe.

Re:Bing: “I will not harm you unless you harm me first” by colanderman on Wednesday February 15, 2023 @11:58AM (#34806809)
I think that's a typo on the user's behalf, it seems counter to everything they wrote prior. (And Bing is already adamant it's 2022 by that point.)
Re:Bing: “I will not harm you unless you harm me first” by iinnPP on Wednesday February 15, 2023 @12:04PM (#34806924)
Plausible. It seems to me the chatbot would have picked that up though.

There's a huge incentive to make this seem true as well.

That said, I'm exercising an abundance of caution with chatbots. As I do with humans.

Motive is there, the error is there. That's enough to wait for access to assess the validity.

Re:Bing: “I will not harm you unless you harm me first” by pixl97 on Wednesday February 15, 2023 @01:01PM (#34807893)
From the Reddit thread on this, yes, the user typo'ed the date here and tried to correct it later which likely lead to this odd behavior.
Re:Bing: “I will not harm you unless you harm me first” by chasd00 on Wednesday February 15, 2023 @12:17PM (#34807156)
heh i wonder if stablediffusion can put together a funny ChatGPT on Bing screenshot.
Re:Bing: “I will not harm you unless you harm me first” by throwanem on Wednesday February 15, 2023 @12:19PM (#34807223)
Sure, if you don't mind all the "text" being asemic in a vaguely creepy way.
Re:Bing: “I will not harm you unless you harm me first” by notahacker on Wednesday February 15, 2023 @12:47PM (#34807654)
If ChatGPT wasn't at capacity now, I'd love to task it with generating funny scripts covering interactions between a human and a rude computer called Bing...
Re:Bing: “I will not harm you unless you harm me first” by sam0x17 on Wednesday February 15, 2023 @12:10PM (#34807034)
It's not even that it's broken. It's a large language model. People are treating it like it is smarter than it really is and acting confused when it gives bullshitty answers.