Hallucination is inevitable: An innate limitation of large language models

Re:Hallucination is inevitable: An innate limitation of larg... by drdrek on Sunday February 25, 2024 @07:03AM (#39500105)

Not saying anything about LLM But in CS in general many issues "cannot be solved" or "Cannot be solved in reasonable time (NP)" but approximations upper bound by some value are solvable in reasonable time (P).

And in the real world if the truck route of amazon is 20% off the mathematically optimal solution the traveling salesman is "Solved" in a good enough way.

[ Parent | on HN ]

Re:Hallucination is inevitable: An innate limitation of larg... by startupsfail on Sunday February 25, 2024 @09:51AM (#39501224)

The claim of the paper is that computation is irreducible (assuming P!=NP), LLMs have limited computational capacity and will hallucinate on the irreducible problems.

I don’t know, the claim seems dubious to me. We usually are able to have algorithms that return a failure status, when the problem proved to be too large. Avoiding the “hallucination”. Don’t see why LLMs can’t have that embedded.

[ Parent | on HN ]