Re:Hallucination is inevitable: An innate limitation of larg...
by barrkel on Sunday February 25, 2024 @06:44AM
(#39500019)
LLMs are token completion engines. The correspondence of the text to the truth or authoritative sources is a function of being trained on text like that; with the additional wrinkle that generalization from training (a desired property or it's just a memorization engine) will produce text which is only plausibly truthful, it only resembles training data.
Getting beyond this is a tricky dark art. There isn't any simple there. There's nowhere to put an if statement.
Getting beyond this is a tricky dark art. There isn't any simple there. There's nowhere to put an if statement.