News for hackers. Stuff that matters.
Re:Llama 2 – Meta AI by sebzim4500 on Tuesday July 18, 2023 @05:32PM (#36779363)
They kind of do, since the predictions are well calibrated before they go through RLHF, so inside the model activations there is some notion of confidence.

Even with a RLHF model, you can say "is that correct?" and after an incorrect statement it is far more likely to correct itself than after a correct statement.

There are no comments on this comment yet.