Re:The Geometry of Truth: Do LLM's Know True and False
by TeMPOraL on Friday October 20, 2023 @05:34AM
(#37954018)
There's an asymmetry here, too. "The sky is ${color}", with no extra context, has one obvious answer for us living here, today. Whereas for "Blue is the color of ${thing}", with no extra answer, there's an insane amount of equally sensible substitutions for ${thing}. Without extra content, the model has no reason to privilege "sky" over any other equally valid answer.
"The sky is blue" does not imply "blue is the sky".