Re:Can GPT-4 and GPT-3.5 play Wordle?
by terramex on Tuesday March 21, 2023 @02:56AM
(#35243229)
Yes, but it has some issues in latest models.
> GPT-4 can also be confidently wrong in its predictions, not taking care to double-check work when itβs likely to make a mistake. Interestingly, the pre-trained model is highly calibrated (its predicted confidence in an answer generally matches the probability of being correct). However, after the post-training process, the calibration is reduced (Figure 8).
> GPT-4 can also be confidently wrong in its predictions, not taking care to double-check work when itβs likely to make a mistake. Interestingly, the pre-trained model is highly calibrated (its predicted confidence in an answer generally matches the probability of being correct). However, after the post-training process, the calibration is reduced (Figure 8).
pages 10-11: https://cdn.openai.com/papers/gpt-4.pdf