News for hackers. Stuff that matters.
Re:Show HN: A Word Guessing game like Codenames that allows ... by cheekygeeky on Friday November 06, 2026 @04:38PM (#50398860)
Daniel, GREAT job. This is fascinating. Your leaderboard is based upon ELO, correct? I can't find anywhere that you describe the formula for calculating the ELO score. It seems like we would need to verify that is indeed an accurate way to judge the Model Leaderboard. Care to share?
Re:Show HN: A Word Guessing game like Codenames that allows ... by daluan on Friday November 06, 2026 @04:44PM (#50398918)
Yup, that's a fair question. It's not exactly running Elo. It's more of a Bradley-Terry fit over all games at once, shown on the Elo scale (400 points = 10:1 odds). Game order doesn't change it. I also have each board played twice with both sides swapped to ensure fairness, so, for example, if one game has Kimi with 9 red words and Claude with 8 blue words, I make new agents of those same models where Claude now has those same 9 red words from Kimi and Kimi now has those 8 blue words from Claude.