News for hackers. Stuff that matters.

A comment on Being confidently wrong is the only thing holding AI back. Parent comment

Re:Being confidently wrong is the only thing holding AI back by CodexArcanum on Friday August 22, 2025 @09:50AM (#44984694)
LLMS don't "hallucinate" they generate a stochastic sequence of plausible tokens that, in context when read by a human, are a false statement or nonsensical.

They also dont have an internal world model. Well I don't think so, but the debate is far from settled. "Experts" like the cofounders of various AI companies (whose livelihood depends on selling these things) seem to believe that. Others do not.

https://aiguide.substack.com/p/llms-and-world-models-part-1

https://yosefk.com/blog/llms-arent-world-models.html

[ Parent | on HN ]
Re:Being confidently wrong is the only thing holding AI back by ninetyninenine on Friday August 22, 2025 @11:27AM (#44985778)
I’m not talking about startups with financial stake. I’m talking about academics and researchers who have zero financial stake and are observing the phenomenon. It is utterly clear now that stochastic parroting is not what’s going on.
[ Parent | on HN ]