Re:The Unbearable Cheapness of Open Weight Models
by therobots927 on Thursday June 25, 2026 @09:15PM
(#48681251)
Are you an anthropic insider or something? Because if you are you should delete this comment. If you aren’t then you don’t know what the hell you’re talking about.
[ Parent
| on HN ]
Re:The Unbearable Cheapness of Open Weight Models
by xquce on Friday June 26, 2026 @02:08AM
(#48682908)
Surely the same can be said for the people saying the opposite?
Re:The Unbearable Cheapness of Open Weight Models
by therobots927 on Friday June 26, 2026 @07:29AM
(#48685382)
I didn’t make a claim. The parent explicitly said it was a misconception that inference is not profitable.
No one knows if it’s profitable or not so we’re left to speculate.
Re:The Unbearable Cheapness of Open Weight Models
by Bnjoroge on Friday June 26, 2026 @09:35AM
(#48686498)
You can make a fairly decent assumption by calculating the margin on serving glm 5.2, and adding say 30% extra costs and it still leaves a healthy margin
Re:The Unbearable Cheapness of Open Weight Models
by therobots927 on Friday June 26, 2026 @10:17AM
(#48686891)
Where are you getting 30% from
Re:The Unbearable Cheapness of Open Weight Models
by Bnjoroge on Friday June 26, 2026 @10:51AM
(#48687337)
It was a rough heuristic for how much more opus/5.5 would presumably cost if you extrapolate from glm5.2 prices. In any case input tokens for 5.4/4.6 are 70-100% more expensive, cached about 3-100%, and output tokens anywhere from 60%-240% more as per all their current api pricing. I highly doubt 5.4/4.6 are that much more expensive to serve given how cheap and commoditized inference has become, and how comparable they are perfomance wise.
Re:The Unbearable Cheapness of Open Weight Models
by rcxdude on Friday June 26, 2026 @09:09AM
(#48686194)
For one point, you can look at the costs of similarly sized open-source models from inference providers (which are only making money on the markup on the compute), and compare with anthropic's prices. There's a pretty big price difference there and it would be hard to believe that anthropic's models are that much more expensive to run than those models.
Re:The Unbearable Cheapness of Open Weight Models
by tomnipotent on Friday June 26, 2026 @05:55PM
(#48692477)
Those prices don't need to bake in the training cost, since it was eaten by someone else (whomever trained the open source models). Anthropic et al. need to price in the whole lifecycle.
Re:The Unbearable Cheapness of Open Weight Models
by rcxdude on Saturday June 27, 2026 @07:32AM
(#48697336)
Yes, but the point is specifically on whether inference in and of itself is profitable (i.e. whether the unit economics work out). They are still losing money overall, but they're not losing more money the more people use their product (quite the opposite: they need a lot of users at their fairly large per-token margins in order to justify their R&D spend, and the big question IMO is how strong the opposite side is: how much money do they need to spend on R&D to have a product that justifies such a high per-token premium?).