News for hackers. Stuff that matters.

A comment on Generative AI doesn't have a coherent understanding of the world. Parent comment

Re:Generative AI doesn't have a coherent understanding of th... by mdp2021 on Friday November 15, 2024 @08:45AM (#42146868)
We build approximations: we develop world models. That suffices. That the product is incomplete is just a matter of finiteness.
[ Parent | on HN ]
Re:Generative AI doesn't have a coherent understanding of th... by Melonotromo on Friday November 15, 2024 @11:27AM (#42148380)
We build them as we do because we grow up in them first.

AI gets trained on a lot of different worlds (books, stories, science, etc. )

[ Parent | on HN ]
Re:Generative AI doesn't have a coherent understanding of th... by mdp2021 on Saturday November 16, 2024 @03:16AM (#42155224)
No, that is irrelevant and false. False, because we also access sub-worlds - the world model is made of contexts -, like LLMs (not «AI»).

Irrelevant, because for the intended purpose (reasoning over a reliable representation of the world) there is no need for an interactive stream - the salient examples of interaction, cause and effect, are provided by the dataset.

A large perception model "LPM" will not be superior to a large language model "LLM" if its underlying system is not superior.

[ Parent | on HN ]