OpenAI postmortem – Unexpected responses from ChatGPT

Re:OpenAI postmortem – Unexpected responses from ChatGPT by mcguire on Wednesday February 21, 2024 @09:37PM (#39462485)

"Akin to being lost in translation, the model chose slightly wrong numbers, which produced word sequences that made no sense. More technically, inference kernels produced incorrect results when used in certain GPU configurations."

Several of the examples I saw involved ChatGPT going into what looked like repetitive (but not completely so) output loops. I'm not sure that "explanation" matches the things.

[ Parent | on HN ]

Re:OpenAI postmortem – Unexpected responses from ChatGPT by Fatalist_ma on Wednesday February 21, 2024 @11:33PM (#39463286)

I remember Bing Chat doing that sometimes in the first days when it was rolled out. Could it be the "temperature" set too high (or interpreted incorrectly) in some instances?

[ Parent | on HN ]

Re:OpenAI postmortem – Unexpected responses from ChatGPT by treyd on Wednesday February 21, 2024 @09:51PM (#39462584)

I can imagine it'd get screwy when the incorrect output token selection gets fed back into the model with the correct incorrect token selection with nonsense tokens. It's plausible.

[ Parent | on HN ]