News for hackers. Stuff that matters.
Re:Nvidia deliberately kept GPU prices high through circular... by sysmax on Sunday November 15, 2026 @12:37AM (#50504303)
If you run it at home, it won't be realistically doing it 24/7. 8 hours per day is already 33% utilization. If the model is actually running half of that time, it's already 15%.

So, there will be always business for someone to host one in a data center, and sell the tokens at a markup, that will still be cheaper than buying something you will only use 15% of the time.

I don't think it's currently possible to calculate a reasonable valuation for an AI company using conventional techniques. It is too new, it is still rapidly evolving, nobody knows how it will reshape the industry. It's more of a poker game where the underwriters are betting on how much the investors are willing to throw into a perceived once-in-20-years oportunity.

Re:Nvidia deliberately kept GPU prices high through circular... by ctkhn on Sunday November 15, 2026 @12:47AM (#50504345)
There's a lot of use cases where you may not be personally interacting constantly but the LLM is running a lot of the time. A consumer-hostable model like qwen3.8 flash next take longer than opus or better models to complete software builds, and I set mine off before bed, before work, and over lunch to take the next stage of some feature. It is running pretty consistently, just over more time than if it ran on the more powerful datacenter hardware that we use at work.
Re:Nvidia deliberately kept GPU prices high through circular... by sysmax on Sunday November 15, 2026 @01:20AM (#50504482)
The math still doesn't add up.

Let's say, you get 80 tokens/sec, so 80 * 3600 * 24 = ~7M tokens or $3.3/day at the current OpenRouter token pricing. That's ~2 years to break even at $2000.

That's also about 7kWh/day assuming 300W, so net $2/day or ~3 years. Given how fast the hardware changes, it makes no sense at all.

Also, in my experience, Qwen 3.8 heavily relies on reasoning to produce meaningful results. So where Gemini-Flash would just give you a usable result in like 5 seconds, Qwen would stumble on a trivial technicality (like completely forget '+' and '-' in a patch), then reason for a minute or two on "hey, but what about that requirement, maybe it is related"? and eventually come to the right answer. But the speed and the token use is abysmal.

I mean, it's a cool model and it's a big step, and it's crucial to have open-weight AI, but currently it's not practical beyond proof-of-concept.