News for hackers. Stuff that matters.
Re:Chain-of-Thought Can Hurt Performance on Tasks Where Thin... by naasking on Thursday October 31, 2024 @01:04PM (#42008814)
> A world model is not a requirement for next token prediction in general.

Conjecture. Maybe they all have world models, they're just worse world models. There is no threshold beyond which something is or is not a world model, there is a continuum of models of varying degrees of accuracy. No human has ever had a perfectly accurate world model either.

> One white paper with data that _suggests_ the author’s hypothesis is far from proof.

This is far from the only paper.

> This is a tired stochastic parrot argument that I don’t feel like engaging again, sorry.

Much like your tired stochastic parrot argument about LLMs.

There are no comments on this comment yet.