News for hackers. Stuff that matters.

A comment on Internal representations of LLMs encode information about truthfulness. Parent comment

Re:Internal representations of LLMs encode information about... by justinpombrio on Wednesday October 30, 2024 @12:19PM (#41996911)
That's correct on two fronts. First, I put "false" in quotes everywhere for a reason: I'm talking about the sort of thing that people would say is false, not what's actually false. And second, yes, I'm merely claiming that it's in theory learnable (in contrast to the OP's claim), not that it will necessarily be learned.
[ Parent | on HN ]
Re:Internal representations of LLMs encode information about... by RandomLensman on Wednesday October 30, 2024 @12:31PM (#41997075)
Am not sure the second part is always true: there might be situations where statistical approaches could be made kind of "infinitely" accurate as far as data is concerned but still represent a complete misunderstanding of the actual situation (aka truth), e.g., layering epicycles on epicycles in a geocentric model of the solar systems.

Some data might support a statistical approach other might not even though it might not contain misrepresentations as such.

[ Parent | on HN ]