News for hackers. Stuff that matters.
Re:Show HN: Open-source model routing for coding agents at A... by adchurch on Friday October 02, 2026 @03:35PM (#49937611)
> I’m not really sure, I can’t say I trust any kind of synthetic AI benchmarks.

Fair enough but what exactly were you thinking when you said:

> I would like to see this (and any model router, frankly) benchmarked against two things

And thanks for sharing about failure cases! Those do sound like strange harness-level things, honestly we haven't seen failure cases like that crop up in our own usage & testing.

There are no comments on this comment yet.