I didn't say inference through the API was unprofitable, I said token generation is heavily subsidized, artificially inflating demand.

Semianalysis estimates that subscriptions make up 40% of tokens generated for only the 10% of the revenue:

https://newsletter.semianalysis.com/p/anthropic-subscription...

I'm also not saying that this subsidy is irrational, it does buy mindshare, but it still distorts the true demand for tokens. I wouldn't be using anywhere near as many tokens if the price was as high as the API costs, if anything I would switch to a cheaper model, and likely not an Anthropic one.

If you're gonna point to gross margins on the API, those 85% really are meaningless in isolation. They can charge top dollar because they have one of the top models, but only because they keep spending top dollar on training it, as does OpenAI. It's a game of chicken where whoever stops heavy training investments first is likely the one to lose market share to whoever keeps spending. So the play is to try and keep the investment capital flowing and be the last one standing, which only works if you can keep selling a fantasy of future revenue, not the dire reality of current revenue.