Internal representations of LLMs encode information about truthfulness

Re:Internal representations of LLMs encode information about... by beezlebroxxxxxx on Wednesday October 30, 2024 @11:40AM (#41996325)

> There is some model of truthfulness encoded in our heads, and we don't draw all of that from our direct experience. For instance, I have never been to Connecticut or Moscow, but I still think that it is false that the capital of Connecticut is Moscow.

Isn't this just conveniently glossing over the fact that you weren't taught that. It's not a "model of truthfulness", you were taught facts about geography and you learned them.

[ Parent | on HN ]

Re:Internal representations of LLMs encode information about... by genrilz on Wednesday October 30, 2024 @11:49AM (#41996465)

I mean, sure. OP implied that "capital of Connecticut is Moscow" is the sort of thing that a human "model of truthfulness" would encode. I'm pointing out that the human model of that particular fact isn't inherently any more truthy than the LLM model.

I am saying that humans can have a "truther" way of knowing some facts through direct experience. However there are a lot of facts where we don't have that kind of truth, and aren't really on any better ground than an LLM.

[ Parent | on HN ]