News for hackers. Stuff that matters.

A comment on Advancing AI Benchmarking with Game Arena.

Re:Advancing AI Benchmarking with Game Arena by ofirpress on Monday February 02, 2026 @01:23PM (#46859331)
This is a good way to benchmark models. We [the SWE-bench team] took the meta-version of this and implemented it as a new benchmark called CodeClash -

We have agents implement agents that play games against each other- so Claude isn't playing against GPT, but an agent written by Claude plays poker against an agent written by GPT, and this really tough task leads to very interesting findings on AI for coding.

https://codeclash.ai/

[ Parent | on HN ]
Re:Advancing AI Benchmarking with Game Arena by 63stack on Monday February 02, 2026 @02:25PM (#46860086)
>this really tough task leads to very interesting findings on AI for coding

Are you going to share those with the class or?

[ Parent | on HN ]
Re:Advancing AI Benchmarking with Game Arena by Instantnoodl on Monday February 02, 2026 @02:11PM (#46859928)
Cool to see core war! I feel it's mostly forgotten by now. My dad is still playing it to this day though and even attends tournaments
[ Parent | on HN ]
Re:Advancing AI Benchmarking with Game Arena by riku_iki on Monday February 02, 2026 @01:44PM (#46859602)
Leaderboard looks very outdated..
[ Parent | on HN ]
Re:Advancing AI Benchmarking with Game Arena by RobRivera on Monday February 02, 2026 @04:54PM (#46862220)
https://ai.meta.com/research/publications/gaia-a-benchmark-f...

?

[ Parent | on HN ]