Re:Internal representations of LLMs encode information about...
by kelseyfrog on Wednesday October 30, 2024 @12:54PM
(#41997410)
Are LLMs Gettier machines? I'm confident saying yes and that hallucinations are a consequence of this.
EDIT: I've had some time to think and if you read somewhere that Hartford is the capital of Connecticut, you're right in a Gettier way too. Reading some words that happen to be true is exactly like using a picture of your room as your zoom background. It is a facsimile of the knowledge encoded as words.
t. @abouelleill