Re:Claude 3 model family
by scrollop on Monday March 04, 2024 @02:33PM
(#39594887)
So your theory would have it that if you repeated the question at temp 1 it would give the wrong answer more often than the correct answer?
[ Parent
| on HN ]
Re:Claude 3 model family
by throwaway63820 on Monday March 04, 2024 @03:50PM
(#39595882)
There's no theory.
Just in real life usage, it is extremely uncommon to stochastically query the model and use the most common answer. Using it with temperature 0 is the "best" answer as it uses the most likely tokens in each completion.