Re:Llama 2 – Meta AI
by sebzim4500 on Tuesday July 18, 2023 @05:32PM
(#36779363)
They kind of do, since the predictions are well calibrated before they go through RLHF, so inside the model activations there is some notion of confidence.
Even with a RLHF model, you can say "is that correct?" and after an incorrect statement it is far more likely to correct itself than after a correct statement.
Even with a RLHF model, you can say "is that correct?" and after an incorrect statement it is far more likely to correct itself than after a correct statement.