Wrong statements about Python are simply less probable than wrong statements about Rust, since there is more Python than Rust in the training data.
That changes exactly nothing about the fact that the system isn't able to detect when it makes a blunder in Python.
That is not what we've observed though. Quite the opposite - we're seeing that the bigger LLM is and the more domain-specific material it digested, the more truthful it becomes.
Yes it can still make an error and be unable to spot it, but so can I.
No, that is not my claim. That is part of the explanation for it.
My claim is this: An LLM is incapable of knowing when it produces false information, as it simply doesn't have a concept of "truthfulness". It deals in probabilities, not alignment with objective reality.
And it doesn't matter how big you make them...this fact cannot change, as it is rooted in the basic MO of language models.
So, now that we have covered what my claim actually is...
> That is not what we've observed though. Quite the opposite - we're seeing that the bigger LLM is and the more domain-specific material it digested, the more truthful it becomes.
...I can ask what this observation has to do with it, and the answer is: Nothing at all. LMs with more params may produce untruthful statements less often, but what does this change about their ability to recignize when they do produce them? And the answer is: Nothing. They still can't.
a LLM can indeed know when it produces likely incorrect responses. Not a hypothetical.
What's the point of making claims you have no intention of rescinding regardless of evidence ? People are so funny.