News for hackers. Stuff that matters.

A comment on Advancing AI Benchmarking with Game Arena. Parent comment

Re:Advancing AI Benchmarking with Game Arena by 10xDev on Monday February 02, 2026 @02:35PM (#46860214)
It is a program. I need it to get task X done and I don't care how, whether it is strictly through CoT or with tools. There is no such thing as cheating in real work and no reason to handicap it. Just test the limits of what it can do with whatever means possible.

Trying to solve everything with CoT alone without utilising tools seems futile.

[ Parent | on HN ]
Re:Advancing AI Benchmarking with Game Arena by simianwords on Monday February 02, 2026 @02:51PM (#46860442)
you are not understanding. its a proxy for how well it does other things.
[ Parent | on HN ]
Re:Advancing AI Benchmarking with Game Arena by 10xDev on Monday February 02, 2026 @04:57PM (#46862280)
A good proxy is knowing which tools to use to solve the problem. Not how to try and emulate how a human would play chess. That is pointless...
[ Parent | on HN ]
Re:Advancing AI Benchmarking with Game Arena by simianwords on Tuesday February 03, 2026 @12:18AM (#46866823)
According to you, it says nothing about a person if they are good at chess
[ Parent | on HN ]