News for hackers. Stuff that matters.
Re:Laptop Isn't Ready for LLMs. That's About to Change by oa335 on Tuesday December 23, 2025 @09:11PM (#46371710)
> Inference providers are already profitable.

That surprises me, do you remember where you learned that?

Re:Laptop Isn't Ready for LLMs. That's About to Change by nl on Wednesday December 24, 2025 @12:52AM (#46372864)
Lots of sources, and you can do the math yourself.

Here's a few good ones:

https://github.com/deepseek-ai/open-infra-index/blob/main/20... (suggests Deepseek is making 80% raw margin on inference)

https://www.snellman.net/blog/archive/2025-06-02-llms-are-ch...

https://martinalderson.com/posts/are-openai-and-anthropic-re... (there's a HN discussion of this where it was pointed out this overestimates the costs)

https://www.tensoreconomics.com/p/llm-inference-economics-fr... (long, but the TL;DR is that serving Lllama 3.3 70B costs around $0.28/million tokens input, $0.95 output at high utilization. These are close to what we see in the market: https://artificialanalysis.ai/models/llama-3-3-instruct-70b/... )