Re:Internal representations of LLMs encode information about...
by Terr_ on Wednesday October 30, 2024 @01:22PM
(#41997813)
Another version/interpretation in this "truth" space is whether a model is capturing multi-part correlations with truthy/falsy signals, much like capturing the "sadness" or "sarcasm" of a statement.
In other words, a model might have local contextual indicators, but not be able to recognize global hard logical contradictions.
In other words, a model might have local contextual indicators, but not be able to recognize global hard logical contradictions.