News for hackers. Stuff that matters.

A comment on OpenAI Employee: GPT-4 hasn't gotten worse since March. Parent comment

Re:OpenAI Employee: GPT-4 hasn't gotten worse since March by theturtletalks on Thursday June 01, 2023 @05:47PM (#36157818)
ChatGPT 4 seems to struggle with context changes within the same thread now. I asked it about some parks near me and then switched to asking about code. It just kept responding about the parks even when I corrected it. In some cases, it would merge the park question and the code question. I had not seen that with the free or Plus version until a few days ago.
[ Parent | on HN ]
Re:OpenAI Employee: GPT-4 hasn't gotten worse since March by ars on Thursday June 01, 2023 @09:30PM (#36159762)
You're supposed to click "new conversation" when changing topics.
[ Parent | on HN ]
Re:OpenAI Employee: GPT-4 hasn't gotten worse since March by IIAOPSW on Thursday June 01, 2023 @10:35PM (#36160165)
Just like with a real general intelligence!
[ Parent | on HN ]
Re:OpenAI Employee: GPT-4 hasn't gotten worse since March by ars on Thursday June 01, 2023 @10:41PM (#36160208)
* * *
[ Parent | on HN ]
Re:OpenAI Employee: GPT-4 hasn't gotten worse since March by anonzzzies on Friday June 02, 2023 @01:57AM (#36161575)
> if you were talking to me about something, and midway with no warning or other signal

This happens all the time in a social group setting though. Not much confusion ensues.

[ Parent | on HN ]
Re:OpenAI Employee: GPT-4 hasn't gotten worse since March by bradknowles on Friday June 02, 2023 @03:57AM (#36162387)
Not if you're my wife.

Sometimes I spend several minutes of a conversation trying to figure out which thing she's talking about, because we've already covered like twenty different topics in the last ten minutes and she seems to just switch around at random and with no warning.

Sometimes I get enough context that I can make that swap or stack pop, but many times not.

[ Parent | on HN ]
Re:OpenAI Employee: GPT-4 hasn't gotten worse since March by ars on Friday June 02, 2023 @06:20PM (#36171566)
I think wives believe their husbands can read their mind, and they get annoyed when that doesn't happen :)

But yah, this is exactly what I mean - without some cue, neither humans, nor machines, can tell when you switch conversation.

[ Parent | on HN ]
Re:OpenAI Employee: GPT-4 hasn't gotten worse since March by Jach on Thursday June 01, 2023 @10:42PM (#36160217)
> Should I start a new conversation with you for a new topic or can you switch to a new topic in the same conversation just fine?

> You can continue within the same conversation for a new topic. There's no need to start a new conversation. Feel free to ask about a different topic, and I'll do my best to assist you.

[ Parent | on HN ]
Re:OpenAI Employee: GPT-4 hasn't gotten worse since March by JimmyAustin on Friday June 02, 2023 @02:07PM (#36168696)
GPTs are not trained on themselves, and what little knowledge they have of their own capabilities is limited to the discussion of it in their training set. This is a hallucination.
[ Parent | on HN ]
Re:OpenAI Employee: GPT-4 hasn't gotten worse since March by Jach on Friday June 02, 2023 @02:58PM (#36169275)
I might believe you if we were 'talking' directly to the model, however this is a chat box and clearly something is aware of usage questions and how to answer them. If you've been granted plugin access, enable some and ask it what plugins are enabled and how to use them, 'it' will tell you.
[ Parent | on HN ]
Re:OpenAI Employee: GPT-4 hasn't gotten worse since March by furyofantares on Saturday June 03, 2023 @04:08PM (#36180064)
It's clear that it's aware that it's a chat bot, it's not clear at all that it's aware of usage questions and how to answer them. Its answer being wrong seems to be evidence that it isn't.
[ Parent | on HN ]