Re:Electronic Structure of LK-99
by refulgentis on Tuesday August 01, 2023 @09:55PM
(#36966005)
It's not dumber. You can verify this on their models with any prompt you ran at 0.0 when it first came out, I did. It's the exact same model run the same exact way. They've repeatedly confirmed this.
[ Parent
| on HN ]
> It's not dumber
So I absolutely agree with this. And yet this meme persists. I wonder what's creating the feeling that it's "dumber" in so many? Perhaps they're just noticing the limits that always existed previously? I'm not sure, and am interested in others thoughts on it.
Re:Electronic Structure of LK-99
by sheepscreek on Tuesday August 01, 2023 @10:38PM
(#36966316)
ChatGPT as in the paid subscription hosted by OpenAI. Its quality has deteriorated. It will miss the simplest details in the prompt and hallucinate a lot. I’ve only noticed this before on models with lesser parameters.
In comparison, Bard and Claude are getting better with time.
Re:Electronic Structure of LK-99
by larperdoodle on Wednesday August 02, 2023 @12:06AM
(#36966830)
They've added a lot of safety features. Knowing very little about LLMs, I would assume these prepended prompts are using up a chunk of the limited "attention" the transformer has
Re:Electronic Structure of LK-99
by sheepscreek on Tuesday August 01, 2023 @10:30PM
(#36966268)
They confirmed the API still ran the same base model. But there was no mention of ChatGPT the service. I was referring to the latter above.
The ChatGPT webapp is not the same workflow as the ChatGPT API.
Ooh I have some nice book chapter summaries that ChatGPT generated for me when it first came out. I got them in a Google doc.
If you ask GPT to give you the same thing now, it wont , no matter how hard you try.
That's like hard evidence for me that they've dumbed it down.
Re:Electronic Structure of LK-99
by WithinReason on Wednesday August 02, 2023 @04:50AM
(#36968574)
It is and it's documented:
Re:Electronic Structure of LK-99
by refulgentis on Wednesday August 02, 2023 @06:24AM
(#36969024)
A) its wrong and caused a lot of hand wringing about Arxiv and undergrads
B) Not my claim, those are two different models