News for hackers. Stuff that matters.
Re:Hallucination is inevitable: An innate limitation of larg... by barrkel on Sunday February 25, 2024 @06:44AM (#39500019)
LLMs are token completion engines. The correspondence of the text to the truth or authoritative sources is a function of being trained on text like that; with the additional wrinkle that generalization from training (a desired property or it's just a memorization engine) will produce text which is only plausibly truthful, it only resembles training data.

Getting beyond this is a tricky dark art. There isn't any simple there. There's nowhere to put an if statement.

There are no comments on this comment yet.