News for hackers. Stuff that matters.
Re:Claude 3 model family by scrollop on Monday March 04, 2024 @02:33PM (#39594887)
So your theory would have it that if you repeated the question at temp 1 it would give the wrong answer more often than the correct answer?
Re:Claude 3 model family by throwaway63820 on Monday March 04, 2024 @03:50PM (#39595882)
There's no theory.

Just in real life usage, it is extremely uncommon to stochastically query the model and use the most common answer. Using it with temperature 0 is the "best" answer as it uses the most likely tokens in each completion.