Re:Show HN: A Word Guessing game like Codenames that allows ...
by cheekygeeky on Friday November 06, 2026 @04:46PM
(#50398942)
Thanks for the reply to my earlier question! If I'm understanding your comment, you started them off at different arbitrary scores? Wouldn't it have been fairer to start them off at the same scores (assuming nothing about relative strength) and let the results move the scores up or down from that?
[ Parent
| on HN ]
Re:Show HN: A Word Guessing game like Codenames that allows ...
by daluan on Friday November 06, 2026 @04:54PM
(#50399021)
Yup, good question, and let me clear up some confusion. The model leaderboard has no starting score; every model starts out equal, and all the ratings are calculated together from the full set of results. For example, if a new model gets released, like Gpt 6.1 Terra, we have it play against models like Sonnet 5.5, which we have a lot of data on, to scale its performance against it. (It did a lot better than Sonnet, in case you're curious).