Logits aren't confidence about facts. You can turn on a display like this in the openai playground and you will see it doesn't do what you want.