News for hackers. Stuff that matters.
Re:Language Models in Plato's Cave by latentnumber on Sunday June 29, 2025 @10:34AM (#44413492)
> This explains why video prediction models that learn about the physical world have so far not yielded the same results as next-token prediction on language: while we might hope that models that learn from videos might acquire representations of the physical world in the same way that humans learn through experience, the LLMs have managed to skip this step and simply copy some aspects of human mental representations without having to figure out the learning algorithm that allowed humans to acquire those representations in the first place.

There are no comments on this comment yet.