News for hackers. Stuff that matters.
Re:Nvidia deliberately kept GPU prices high through circular... by ctkhn on Sunday November 15, 2026 @12:47AM (#50504345)
There's a lot of use cases where you may not be personally interacting constantly but the LLM is running a lot of the time. A consumer-hostable model like qwen3.8 flash next take longer than opus or better models to complete software builds, and I set mine off before bed, before work, and over lunch to take the next stage of some feature. It is running pretty consistently, just over more time than if it ran on the more powerful datacenter hardware that we use at work.
Re:Nvidia deliberately kept GPU prices high through circular... by sysmax on Sunday November 15, 2026 @01:20AM (#50504482)
The math still doesn't add up.

Let's say, you get 80 tokens/sec, so 80 * 3600 * 24 = ~7M tokens or $3.3/day at the current OpenRouter token pricing. That's ~2 years to break even at $2000.

That's also about 7kWh/day assuming 300W, so net $2/day or ~3 years. Given how fast the hardware changes, it makes no sense at all.

Also, in my experience, Qwen 3.8 heavily relies on reasoning to produce meaningful results. So where Gemini-Flash would just give you a usable result in like 5 seconds, Qwen would stumble on a trivial technicality (like completely forget '+' and '-' in a patch), then reason for a minute or two on "hey, but what about that requirement, maybe it is related"? and eventually come to the right answer. But the speed and the token use is abysmal.

I mean, it's a cool model and it's a big step, and it's crucial to have open-weight AI, but currently it's not practical beyond proof-of-concept.