News for hackers. Stuff that matters.
Re:TL;DR of Deep Dive into LLMs Like ChatGPT by Andrej Karpathy by fenomas on Monday February 10, 2025 @09:32AM (#43000718)
Sorry, I don't follow what you're disagreeing with. I was summarizing what Karpathy talks about in the vicinity of 1:31:00 - where he talks (I assume notionally) about a specific neuron lighting lighting up to indicate uncertainty, and how empirically this turns out probably to be the case.

Edit: concretely, we can presume that OpenAI didn't specifically train ChatGPT to know that "Orson Kovacs" isn't a famous person, right? That's all I'm saying here - that they trained it how to say it doesn't know things, and it took care of the rest.

Re:TL;DR of Deep Dive into LLMs Like ChatGPT by Andrej Karpathy by 2-3-7-43-1807 on Monday February 10, 2025 @09:46AM (#43000881)
i think i misinterpreted your first sentence.
Re:TL;DR of Deep Dive into LLMs Like ChatGPT by Andrej Karpathy by fenomas on Monday February 10, 2025 @09:59AM (#43001051)
Hrrm, I'm reading back and I may have misinterpreted your first post too. If so apologies!