Re:Auto-compact not triggering on Claude.ai despite being ma...
by judahmeek on Saturday January 24, 2026 @04:06PM
(#46747666)
How hard is benchmarking models actually?
We've got a lot of available benchmarks & modifying at least some of those benchmarks doesn't seem particularly difficult: https://arc.markbarney.net/re-arc
To reduce cost & maintain credibility, we could have the benchmarks run through a public CI system.
We've got a lot of available benchmarks & modifying at least some of those benchmarks doesn't seem particularly difficult: https://arc.markbarney.net/re-arc
To reduce cost & maintain credibility, we could have the benchmarks run through a public CI system.
What am I missing here?