News for hackers. Stuff that matters.

A comment on I think Anthropic and OpenAI have found product-market fit. Parent comment

Re:I think Anthropic and OpenAI have found product-market fit by twobitshifter on Wednesday May 27, 2026 @09:47PM (#48303347)
We have GPU costs, power costs, and how many token/s models can generate on those GPUs. It’s possible to figure out the marginal cost based on this. The current estimate is about $0.40 per million tokens for gpt4 equivalent model. Sonnet 4 is $15 per million tokens, so they are charging high margins on inference. The issue is how large of a margin is needed to recover their costs before the GPUs age out, and how high of a margin can be charged before it’s not economically viable.

https://www.gpunex.com/blog/ai-inference-economics-2026/

[ Parent | on HN ]
Re:I think Anthropic and OpenAI have found product-market fit by rudedogg on Wednesday May 27, 2026 @10:01PM (#48303445)
That seems way off to me.

I skimmed the article, but couldn’t spot any details on their estimates. They mention 70b+ params as being large in several places. But we’ve had several 100b+ param models that trail Sonnet.

[ Parent | on HN ]