News for hackers. Stuff that matters.
Re:ARC-AGI-3 by codeinred on Thursday March 26, 2026 @02:37PM (#47534076)
We're at the point where LLMs and coding agents are supposed to do higher-level work. It makes sense to benchmark them against top human performance, rather than average human performance, because at specialized tasks, average human performance isn't enough.

The issues you described seem like they're actually strengths of the benchmark.

There are no comments on this comment yet.