News for hackers. Stuff that matters.
Re:Claude Opus 5 by TeMPOraL on Friday July 24, 2026 @02:01PM (#49039416)
Who are the customers though? Honest question, I'd like to understand it.

For me, anything other than current best available SOTA for any task is unacceptable. The only routing rule I need is "the most powerful model I still have flat-priced quota available for". I mean, why settle for less?

Re:Claude Opus 5 by kxxx on Friday July 24, 2026 @02:11PM (#49039548)
It's very common to use a lesser model for a lesser task, resulting in same quality output. End result: save money while being faster. In many cases, it's a pure win-win.
Re:Claude Opus 5 by lostmsu on Friday July 24, 2026 @02:24PM (#49039716)
But in other many cases you have to redo the work directly or indirectly, and you are more expensive (for now) than even the most expensive models, so sounds like a total lose.
Re:Claude Opus 5 by btown on Friday July 24, 2026 @02:38PM (#49039890)
There are two types of users: those who are able to use subsidized rates, and those who need to use API rates due to audit requirements, enterprise billing, etc.

Model routing for subsidized users takes the form of a "use Opus 5 subagents for implementation" type of system prompt. You lean into a single provider, build tooling around that, and your savings are far beyond anything multi-provider routing can get you.

Model routing for enterprises is far more complex - approaches like https://fireworks.ai/blog/kimik3-fable become necessary for cost control.

Re:Claude Opus 5 by pzo on Friday July 24, 2026 @02:54PM (#49040112)
on top of that there is also additional factor: speed - sometimes if task is easy you do care to finish it faster.

There is also matter about convenience - when I ask some small easy question often I don't bother to switch the model or forget in prompt to ask faster/cheaper subagent.

Re:Claude Opus 5 by Slartie on Friday July 24, 2026 @02:32PM (#49039807)
And you do not have flat priced quota for Fable 5, right? Because nobody has, as far as I know. So you'll probably not route any task to the "current best available SOTA".

Also: quota. Implies you do not have unlimited access even for flat prices. Which in turn implies that as soon as you hit the quota on the most expensive flat price plan, even you will suddenly discover the magic of economically sensible behavior.

Re:Claude Opus 5 by abi on Friday July 24, 2026 @02:38PM (#49039888)
Fable 5 is included in the Claude Max subscription. I've gotten close to the limits this week and last but haven't hit it yet.
Re:Claude Opus 5 by dgellow on Friday July 24, 2026 @02:51PM (#49040052)
But Fable is only available for 50% of your Max quota as far as I understand
Re:Claude Opus 5 by paxys on Friday July 24, 2026 @02:53PM (#49040093)
I’m assuming you don’t pay per API call. Every mid-large sized business in the world does.
Re:Claude Opus 5 by msabalau on Friday July 24, 2026 @02:09PM (#49039521)
Not everyone is you. Other people probably have a range of tasks that can accomplished with different models.

Certainly if I'm confident that I'm going to get what I need from a faster model, that's what I want to use, rather than wasting time grinding away for the sake of saying of the same answer came from a SOTA model.

Given that every chatbot does offer a range of models, it seems clear people do choose among options.

Re:Claude Opus 5 by internet2000 on Friday July 24, 2026 @02:36PM (#49039860)
The mental effort in estimating what model would be better is so not worth it.

I just want to switch to Claude Code, tell it to turn a .csv into a BigQuery table then cmd+tab to something else while it runs. Thinking "oh this is probably an easy task, I can /model to Sonnet to save $0.0004" is silly.

Re:Claude Opus 5 by resonious on Saturday July 25, 2026 @12:26AM (#49044523)
The game changes when it's not just "Opus vs Sonnet", but "Opus vs GLM". The amount saved is way more than even $0.04. And it's not only money but speed. Some providers can serve GLM crazy fast - I'll even go outside of my subscription to pay extra money for the quick results.
Re:Claude Opus 5 by toyg on Saturday July 25, 2026 @04:02AM (#49045516)
Not everything is interactive, and what the routers do is precisely take away that mental effort on repeated tasks.
Re:Claude Opus 5 by tackta on Saturday July 25, 2026 @05:46AM (#49046134)
People actually use the models for more than writing code.

I barely used Fable because of the rate limits. It just makes more sense to use Opus.

If there were no limits it would be different.

It is not to save a fraction of a penny, it is to be able to still use the model within the limit on the week for $20.

Re:Claude Opus 5 by polotics on Friday July 24, 2026 @02:06PM (#49039474)
because "less" can be so much faster?
Re:Claude Opus 5 by kxxx on Friday July 24, 2026 @02:09PM (#49039529)
not just that -- "less" ($$$) can also result in indistinguishable quality for some tasks/inputs. I'd argue this is the primary reason, secondary being speed.
Re:Claude Opus 5 by jnwatson on Friday July 24, 2026 @02:18PM (#49039646)
I generally agree. Perhaps there's only a 5% chance that it would write better code or find a bug that it wouldn't have with a lesser model, but the economics of bugs is strong enough that preventing a single bug is worth hundreds of dollars.
Re:Claude Opus 5 by TacticalCoder on Friday July 24, 2026 @02:59PM (#49040206)
> For me, anything other than current best available SOTA for any task is unacceptable.

Then you must route. An article with lots of upvotes yesterday or two days ago showed that K3+Fable 5 was more SOTA than either of those.

Re:Claude Opus 5 by toss1 on Friday July 24, 2026 @02:23PM (#49039695)
I'm not a customer of those routing systems, but I quite often use different Claude models for different tasks. While most tasks were Opus 4.8, I often used 4.8 to make a plan, prompts, and package kit to setup Fable for a bigger project, then run it on Fable. Or, for broad single-task searches Sonnet with or without "Research []" turned on seemed to work best both faster, lower overhead, and less verbose answers (when I didn't want it).

OFC, YMMV

Re:Claude Opus 5 by StilesCrisis on Friday July 24, 2026 @04:56PM (#49041484)
That's nice and all, as long as flat-priced quota continues to exist. Seems unlikely to go on forever!
Re:Claude Opus 5 by kelnos on Friday July 24, 2026 @10:44PM (#49044023)
Sometimes you can get an equivalent result in a fraction of the time using a less capable model.

The problem is of course knowing ahead of time that the faster model can give you the same result.