News for hackers. Stuff that matters.

A comment on Hallucination is inevitable: An innate limitation of large language models. Parent comment

Re:Hallucination is inevitable: An innate limitation of larg... by cultureswitch on Sunday February 25, 2024 @03:19PM (#39504353)
Should it matter how the object of debate interacts and probes the external world? We sense the world through specialized cells connected to neurons. There's nothing to prevent LLMs doing functionally the same thing. Both human brains and LLMs have information inputs and outputs, there's nothing that can go through one which can't go through the other.
[ Parent | on HN ]
Re:Hallucination is inevitable: An innate limitation of larg... by mannykannot on Sunday February 25, 2024 @06:00PM (#39505828)
A current LLM does not interact with the external world in a way that would seem to lead to an understanding of it. It emits a response to a prompt, and then reverts to passively waiting for the next one. There's no way for it to anticipate something will happen in response, and thereby get the feedback needed to realize that there is more to the language it receives than is contained in the statistical relationships between its tokens. If its model is updated in the interim, it is unaware, afterwards, that a change has occurred.
[ Parent | on HN ]