News for hackers. Stuff that matters.
Re:Claude Opus 5 by posix_compliant on Friday July 24, 2026 @02:48PM (#49040007)
I think what the parent is saying is that the model itself has the best context for whether a portion of a request should be routed. The specifics of that routing (e.g., should you route to KimiK2) are something that can be trained, finetuned, or even included in a model's startup context.
Re:Claude Opus 5 by johnfn on Friday July 24, 2026 @06:57PM (#49042626)
This doesn't seem quite right. For one, I don't need all the intelligence of an expensive model like Opus 5 to do the relatively simple task of choosing a correct model for a task. Additionally, since this isn't something Anthropic would ever put effort into doing well, you could tune a model to do better and faster than Opus 5 does out of the box.
Re:Claude Opus 5 by kolinko on Friday July 24, 2026 @07:22PM (#49042829)
Are you speaking from experience?

My experience is the opposite - for many cases it’s not very obvious how good a model needs to be to solve it. Worse models tend to just follow their first instincts without proper reasoning

And also btw you don’t need a routing company to decide, you can do it on your harness. And yeah my Fable has zero issues delegating to Terra instead of Opus.

Re:Claude Opus 5 by dannyw on Friday July 24, 2026 @10:19PM (#49043894)
Are you thinking of single shot? For agentic use cases, your ability to manage cache and context becomes much more important. Price per individual request becomes less about tokens and more about cache.
Re:Claude Opus 5 by ai-x on Sunday July 26, 2026 @02:47PM (#49061090)
Smarter models will always route better because it is an intelligent/judgement activity