Re:Microsoft and OpenAI Working on ChatGPT-Powered Bing in C...
by int_19h on Wednesday January 04, 2023 @03:46PM
(#34251280)
ChatGPT doesn't say anything of the sort. In fact, it will vehemently insist that what it says is not necessarily true or accurate if you challenge it.
Re:Microsoft and OpenAI Working on ChatGPT-Powered Bing in C...
by bambax on Wednesday January 04, 2023 @04:02PM
(#34251541)
I'm sorry but this is demonstrably false. I have posted examples of this on HN before. Yes, if you tell ChatGPT that it's wrong, in some cases it says "I'm sorry" and tries again (and produces some other random guess). But if you ask it "are you sure?" it invariably affirms that yes, it's sure and it's in the right.
Re:Microsoft and OpenAI Working on ChatGPT-Powered Bing in C...
by int_19h on Thursday January 05, 2023 @12:06AM
(#34256219)
Hm, you're right. I'm pretty sure that it wasn't so gung-ho when I played with it earlier, but now even very explicit instructions along the lines of "you should only answer "yes" if it is absolutely certain that this is the correct answer" still give this response. Ditto for prompts like "is it possible that your answer was incorrect?"
Re:Microsoft and OpenAI Working on ChatGPT-Powered Bing in C...
by whodev on Thursday January 05, 2023 @11:15AM
(#34261990)
I like bouncing my code problems off ChatGPT, it can give me an answer and I don't feel bad if I forgot something simple. The issue is I've had it give me completely wrong code only for it to be like "I'm sorry" and provide a second incorrect response.
A "bullshit sandwich" if you will.
When one tells people this we get the reply "but so do random blogs! or reddit comments!". Well yes, but they're just random blogs and reddit comments, often peppered with syntactic and spelling mistakes, non sequiturs, and other absurdities. Nobody would take them seriously.
ChatGPT is very different. It doesn't say "this random redditor says this, and this other random redditor says the exact opposite, so IDK, I'm just a machine, please make up your mind".
What it says is "this is the absolute truth that I, a 'large language model', have been able to extract from the vast amount of information I have been trained on. You can rely on it with confidence."
I'm sorry to sound hyperbolic but this cannot end well.