News for hackers. Stuff that matters.
Re:Auto-compact not triggering on Claude.ai despite being ma... by judahmeek on Saturday January 24, 2026 @04:06PM (#46747666)
How hard is benchmarking models actually?

We've got a lot of available benchmarks & modifying at least some of those benchmarks doesn't seem particularly difficult: https://arc.markbarney.net/re-arc

To reduce cost & maintain credibility, we could have the benchmarks run through a public CI system.

What am I missing here?

There are no comments on this comment yet.