News for hackers. Stuff that matters.
Re:Nvidia deliberately kept GPU prices high through circular... by hadlock on Saturday November 14, 2026 @08:48PM (#50503185)
If the price of the RTX 6000 (96gb blackwell gpu) drops to $2000 (original MSRP $8000, currently $16,000 usd due to "scarcity") then, all of a sudden, "we have ai at home" becomes real and why would you ever pay for a subscription for your company/family when you can run Qwen Flash Next (which runs great on consumer GPU via software like Strata) forever for free?

Engineering types and power users need not apply,but For Everyone Else, the "normies", Qwen Flash Next is probably "640k is enough for anyone" territory.

IPO, valuation etc depend heavily on frontier, or "good enough" AI to need to run on commercial grade GPUs. If Qwen Flash Next is good enough and runs on a $2000 GPU, why would you pay $20/30/100/200 per month in perpetuity?

I wouldn't pick Qwen Flash Next to add kernel namespacing and cgroups v2 to my custom OS kernel, but it will happily implement the Plan.md that Fable 5.2 wrote for a dollar.

Re:Nvidia deliberately kept GPU prices high through circular... by searealist on Saturday November 14, 2026 @08:57PM (#50503237)
You would need several RTX 6000 to run the large open weight models, and even then, the price of electricity would probably exceed API prices.
Re:Nvidia deliberately kept GPU prices high through circular... by hadlock on Saturday November 14, 2026 @09:45PM (#50503487)
MoE next token prediction is higher than 80%; you can store the other experts in RAM and the engrams can be streamed off very mediocre nvme. It's been this way since September. I'm running it at home (although heavily quantized, there are limits) on 48gb ram and 12gb gpu. We run it at work on the 96GB RTX at a much better quant.

See also: https://github.com/niko1221/strata

Re:Nvidia deliberately kept GPU prices high through circular... by searealist on Sunday November 15, 2026 @02:15AM (#50504758)
You aren't hitting almost 2x decode with speculation on a MoE model, but it's irrelevant. Electricity will cost most for most people than API will, even with free hardware. And 4-bit qwen next will be a major competitive disadvantage compared to larger models.
Re:Nvidia deliberately kept GPU prices high through circular... by gavmor on Sunday November 15, 2026 @12:12AM (#50504194)
Qwen 3.8 is decent enough for half of what my family would ask it to do.
Re:Nvidia deliberately kept GPU prices high through circular... by wmf on Saturday November 14, 2026 @08:58PM (#50503243)
If RTX 6000 drops to $2000...

That's at or below cost. Nvidia would just stop making them. Of course used cards will reach that price ten years from now.

Re:Nvidia deliberately kept GPU prices high through circular... by bitmasher9 on Sunday November 15, 2026 @12:26AM (#50504270)
An RTX 6000 at $2000 is crazy talk. When was the last time the premium Nvidia workstation GPU retailed at $2000? Probably a decade or longer.
Re:Nvidia deliberately kept GPU prices high through circular... by Aurornis on Saturday November 14, 2026 @08:58PM (#50503245)
> Engineering types and power users need not apply,but For Everyone Else, the "normies", Qwen Flash Next is probably "640k is enough for anyone" territory.

Why would any of those non-power-users buy a $2000 GPU that doubles as a space heater (seriously, try sitting next to one during long runs in the summer) and thousands more for a computer to host it, plus all of the trouble of setting it up, instead of a $20/month subscription?

I do have the hardware to run Qwen3.8-Flash-Next at home, and I still heavily use my subscriptions even for simple tasks. The experience of using the apps on my phone on the go is great and I always have the option to scale the model up to the task.

The people who are going to pay thousands of dollars up front to avoid $20 are power users and people who have different priorities and motivations, like independence or ultimate privacy. GPU prices dropping won’t change that much.

Also, you don’t need an RTX6000 for Q3.8FN. There are much cheaper options right now at lower speeds.

Re:Nvidia deliberately kept GPU prices high through circular... by komali2 on Saturday November 14, 2026 @09:31PM (#50503407)
> The experience of using the apps on my phone on the go is great and I always have the option to scale the model up to the task.

Just sidenote, this experience can be replicated with software like Paseo or some other options.

I usually have a frontier model orchestrating between dumber frontier, Chinese, and local models, using Paseo subagents, from my phone or whatever hardware I'm near.

Though I don't lean too much on the local models, I find them to simply be too stupid. They're fun for experiments though like quizzing them against Wikipedia or making them debate philosophy in loops.

Re:Nvidia deliberately kept GPU prices high through circular... by ericd on Saturday November 14, 2026 @09:34PM (#50503420)
[delayed]
Re:Nvidia deliberately kept GPU prices high through circular... by satvikpendem on Saturday November 14, 2026 @10:04PM (#50503578)
Tokens per second is slower on most local setups than cloud models.
Re:Nvidia deliberately kept GPU prices high through circular... by ericd on Saturday November 14, 2026 @10:07PM (#50503591)
We're talking about RTX Pro 6000s, local models on those are not slower than cloud models. With MTP, you're generally at 200-300 tps on one of the big MoE models in single stream in code generation (the small MTP models tend to be better at code token prediction than prose). The big cloud models are typically <100 tps.
Re:Nvidia deliberately kept GPU prices high through circular... by plorkyeran on Saturday November 14, 2026 @09:38PM (#50503448)
Even if you own a RTX6000 anyway it's not obvious that it's cheaper to run Q3.8FN on it than buying tokens. Google tells me that it can produce ~1 million tokens per hour and uses 450W of power, which for me comes out to 18¢ per million tokens. That's very similar to the price on OpenRouter. Maybe during the winter when all the waste heat cuts your heating bill a bit?
Re:Nvidia deliberately kept GPU prices high through circular... by ericd on Saturday November 14, 2026 @10:04PM (#50503582)
[delayed]
Re:Nvidia deliberately kept GPU prices high through circular... by milkshakes on Saturday November 14, 2026 @10:07PM (#50503590)
it's probably not cheaper, but economics are only one concern at play
Re:Nvidia deliberately kept GPU prices high through circular... by GenerocUsername on Saturday November 14, 2026 @10:22PM (#50503677)
Bingo. It's always cheaper to rent...
Re:Nvidia deliberately kept GPU prices high through circular... by zenoprax on Saturday November 14, 2026 @10:08PM (#50503598)
I did similar math for my card (9070 XT) and it is close to break-even on electricity cost alone nevermind the amortized cost and requirement to have a desktop for it to go into. The parallelization and faster speed of the cloud makes it feel more expensive but it's just doing the same work more quickly.

The strongest case for local AI is for anything requiring privacy/discretion but I don't think individuals will collectively prioritize this. Convenience is king for the majority followed closely by cost. Businesses who care about protecting their competitive edge seem like the more likely candidates for local AI but only if ZDR providers aren't good enough.

Local AI will probably end up where it is now: in the hands of hobbyists and/or privacy-minded people who already own a GPU for gaming.

Re:Nvidia deliberately kept GPU prices high through circular... by horacemorace on Sunday November 15, 2026 @12:22AM (#50504248)
This assumes status quo. The privacy part will become more important as subscriptions become more invasive, ad-ridden, and hostile, as it always seems to go. Local will catch on as hardware availability improves and the community converges on common solutions.
Re:Nvidia deliberately kept GPU prices high through circular... by visarga on Sunday November 15, 2026 @01:40AM (#50504578)
Local models can still surprise us, a small 27B could be much stronger in 2-3 years than today, while capability to run it would exist on more devices.
Re:Nvidia deliberately kept GPU prices high through circular... by zenoprax on Sunday November 15, 2026 @10:47AM (#50507808)
If a company (Apple?) can provide the illusion of privacy and seamless AI integration then they could capture the market of people that are at least aware of the issues.

Despite everything we know about the attention economy the self-hosted community is still a niche group of tech-minded hobbyists. Running anything locally is a commitment and adding expensive hardware to the mix is an even higher barrier.

I want people to care about privacy, technology, and interoperability but I'm just not seeing it happen.

Re:Nvidia deliberately kept GPU prices high through circular... by Aurornis on Sunday November 15, 2026 @02:54PM (#50510085)
> The privacy part will become more important as subscriptions become more invasive, ad-ridden, and hostile

I would bet good money that my $20/month subscriptions are not going to become ad-ridden.

If someone wants to use the free tiers, then nobody is going to be surprised if they see ads.

But these claims that my $20/month plan are going to become “ad-ridden” are at odds with what is happening. I’ve had at least $20/month plans from OpenAI and Anthropic for about as long as they’ve been available, and the quality and amount of inference I get from even the lowest tier are increasing all the time.

At this point, I can run Luna/xhigh on the $20 plan almost constantly (with brief breaks for tool calls doing actual work, not just token generation for fun) and it feels endless. In another 24 months we’ll be doing even higher quality outputs with smaller hosted models on faster cloud hardware and it’s going to be available from many different providers.

The doomsaying about “ad ridden” should be kept to the free plans. It’s just not going to happen on $20/month

Re:Nvidia deliberately kept GPU prices high through circular... by drnick1 on Saturday November 14, 2026 @10:02PM (#50503568)
> Why would any of those non-power-users buy a $2000 GPU that doubles as a space heater

Because, unlike the $20 Claude subscription, your own hardware will not respond "sorry, but I cannot do that" when you try to hack a device or game that you own.

Re:Nvidia deliberately kept GPU prices high through circular... by satvikpendem on Saturday November 14, 2026 @10:05PM (#50503584)
Open weight models are also increasingly starting to deny requests, like recent Kimi showed.
Re:Nvidia deliberately kept GPU prices high through circular... by ericd on Saturday November 14, 2026 @10:13PM (#50503637)
[delayed]
Re:Nvidia deliberately kept GPU prices high through circular... by girvo on Saturday November 14, 2026 @10:53PM (#50503839)
That used to be true. But now the Chinese model companies are just not training their open weight sets on cybersecurity tasks: there’s no censorship to remove, it just doesn’t have that specific ability.
Re:Nvidia deliberately kept GPU prices high through circular... by ericd on Saturday November 14, 2026 @11:16PM (#50503969)
Moonshot reportedly removed some training data, which dinged its cybersecurity ability somewhat, but Kimi still has pretty strong ability - they still reported >80% on their xdev-bench-hard, down from 90% before the data removal. DS 4.1 is supposedly quite good for it (85%), and Z.ai has been talking about how they're trying to improve GLM's cybersecurity abilities, so it doesn't seem like a broad trend.
Re:Nvidia deliberately kept GPU prices high through circular... by girvo on Sunday November 15, 2026 @05:24AM (#50505732)
I hope you're right, but the word on the street is it's part of why Qwen is releasing v4 later than they originally planned. That's only a rumour though, so maybe its complete nonsense!
Re:Nvidia deliberately kept GPU prices high through circular... by ericd on Sunday November 15, 2026 @09:25AM (#50507167)
Yeah, I hope so too!
Re:Nvidia deliberately kept GPU prices high through circular... by Topfi on Sunday November 15, 2026 @03:27PM (#50510360)
Ah yes, all those none-power-user-hackers.
Re:Nvidia deliberately kept GPU prices high through circular... by pkulak on Saturday November 14, 2026 @10:51PM (#50503822)
> instead of a $20/month subscription

And that $20 subscription isn't a good comparison. That gets you Astra or Opus. Better comparison is OpenAI's $8/month plan, which gets you Luna (which scores the same as Qwen on benchmarks). At that price, most of the cost isn't even the model; it's just hosting the infrastructure.

Re:Nvidia deliberately kept GPU prices high through circular... by aalimov_ on Sunday November 15, 2026 @12:54AM (#50504378)
With all of the money these companies owe I don’t think that $20 or even $100 monthly subs will stick around forever, but who knows.
Re:Nvidia deliberately kept GPU prices high through circular... by chii on Sunday November 15, 2026 @01:18AM (#50504468)
This is exactly correct imho.

The same thing happened with uber when they needed to start making money. It's only competition that stopped it from increasing more.

Re:Nvidia deliberately kept GPU prices high through circular... by wmf on Sunday November 15, 2026 @01:23AM (#50504494)
Ironically, going bankrupt would allow them to wipe out the debt, keep the GPUs, and offer cheaper subscriptions.
Re:Nvidia deliberately kept GPU prices high through circular... by coffeebeqn on Sunday November 15, 2026 @01:34AM (#50504548)
Who are we talking about? Pretty sure you’d have to liquidate your GPUs in this case
Re:Nvidia deliberately kept GPU prices high through circular... by karmakurtisaani on Sunday November 15, 2026 @03:38AM (#50505155)
Same level of understanding as thinking going to the town square and screaming "I declare bankruptcy!" frees you from your debt.
Re:Nvidia deliberately kept GPU prices high through circular... by mike_hearn on Sunday November 15, 2026 @04:11AM (#50505302)
I don't think so? A Chapter 11 is only possible if you can demonstrate clearly to the court that the underlying business would be viable without the debts. It also wipes out the investors.

AI startups are characterized by:

1) Market dumping. They are burning investor capital to buy market share.

2) A need to constantly raise money to pay for (1).

A Chapter 11 bankruptcy would make no sense in this situation. They haven't demonstrated that their business model is viable, so if a court ordered a Chapter 11 these firms would just immediately go bankrupt again, and that's usually a criteria to require a different and harsher kind of bankruptcy.

But even if for some reason a court did allow it, they'd still need to do emergency raises because their outgoings are so high. Debt has nothing to do with that, it's purely a matter of fixed costs and (in Anthropic's case at least) huge locked in contracts. But no investor is going to give money to a company that just permanently defaulted on them and ran to court to zero out the value of those shares. So they would be unable to raise and would immediately go bankrupt again.

Re:Nvidia deliberately kept GPU prices high through circular... by godspiral on Monday November 16, 2026 @10:24AM (#50518568)
Most of the "debt" for OpenAI and Anthropic is not debt, but purchase/rental obligations. These are senior to "real debt". The overwhelming problem is that if datacenter builders force bankruptcy takeover, the model assets are only worth $10-20b instead of $1T+ company, because the talent/hype is the company's value, and they all leave if their equity/stock options go down.
Re:Nvidia deliberately kept GPU prices high through circular... by csallen on Sunday November 15, 2026 @01:48AM (#50504609)
Then you just move once they're more expensive. They have essentially no lock-in.
Re:Nvidia deliberately kept GPU prices high through circular... by Aurornis on Sunday November 15, 2026 @02:57PM (#50510102)
Anthropic has so much cash they earn a billion dollars per year in interest.

The reason they’re entering compute contracts is because every dollar they spend on compute for serving their plans (inference) produces more dollars of revenue.

Models are getting better. Serving hardware is getting faster. Fabs are being produced to make more hardware.

Things will only get cheaper and more plentiful from here.

Re:Nvidia deliberately kept GPU prices high through circular... by jitbit on Sunday November 15, 2026 @11:15AM (#50508067)
I live in northern EUrope. I wouldn’t mind a space heater.
Re:Nvidia deliberately kept GPU prices high through circular... by godspiral on Monday November 16, 2026 @10:17AM (#50518485)
models that fit on a single gpu or 96-128gb ram + a 16-32gb gpu as per strata are indeed already good. ddr6 with PIM (matrix multiply) is a path to go without a gpu. It does take a crash on HBM pricing to make everything happen affordably.

Local vs rented vs token pricing all fall at similar rates, though.

Re:Nvidia deliberately kept GPU prices high through circular... by tybit on Saturday November 14, 2026 @09:14PM (#50503327)
No one other than engineering types and power users want to run their own server. Everyone else just wants their phones and laptops to connect to the cloud and do the magic for them.
Re:Nvidia deliberately kept GPU prices high through circular... by doctorpangloss on Saturday November 14, 2026 @09:15PM (#50503329)
Well the $200 plan will cost $20 instead because they have the same input costs, by your theory, or they don't, because energy isn't getting cheaper. Running your cluster at home in California can easily cost $900/mo
Re:Nvidia deliberately kept GPU prices high through circular... by ashkankiani on Saturday November 14, 2026 @09:24PM (#50503366)
> add kernel namespacing and cgroups v2 to my custom OS kernel

deepseek can run locally on my strix halo and handles this kind of thing just fine. it really is good enough already for hands off programming, and hands on looping for slightly more complex stuff.

Re:Nvidia deliberately kept GPU prices high through circular... by pluralmonad on Saturday November 14, 2026 @10:33PM (#50503730)
Which deepseek do you run?
Re:Nvidia deliberately kept GPU prices high through circular... by raincole on Saturday November 14, 2026 @09:45PM (#50503486)
> the "normies"

The normies are not going to pay $2000 upfront just to use AI lol. Why would they?

Re:Nvidia deliberately kept GPU prices high through circular... by singpolyma3 on Saturday November 14, 2026 @10:01PM (#50503561)
Engineering types should be plenty happy with this setup too
Re:Nvidia deliberately kept GPU prices high through circular... by ffaccount2 on Saturday November 14, 2026 @10:03PM (#50503575)
>Qwen Flash Next is probably "640k is enough for anyone" territory.

This is a weird comparison to make, because 640k is known mostly because of how wrong this prediction was. It turned out that people wanted more, and the more RAM was available the more RAM hungry applications were created. So probably the opposite of what you meant (that Qwen will be enough for most).

Re:Nvidia deliberately kept GPU prices high through circular... by hadlock on Saturday November 14, 2026 @10:12PM (#50503626)
It was mostly a nod to the fact that most predictions about technology turn out being wrong, but at that point in time seem perfectly valid.
Re:Nvidia deliberately kept GPU prices high through circular... by ozgrakkurt on Saturday November 14, 2026 @10:29PM (#50503711)
> to add kernel namespacing and cgroups v2 to my custom OS kernel

To be fair, you wouldn't use an LLM for this.

I use LLMs for code review a lot, didn't try Qwen Flast Next but the bigger models do give better reviews so just having this case probably won't apply to me.

Re:Nvidia deliberately kept GPU prices high through circular... by hadlock on Saturday November 14, 2026 @10:38PM (#50503756)
Sol 6.1 did it last night in two sessions, one each for namespaces and cgroups, I didn't even use max. Most of my benchmarks suffered, but not tremendously. I'm about 40% of the way through writing my own CRI to attach k3s to right now.
Re:Nvidia deliberately kept GPU prices high through circular... by andhug on Saturday November 14, 2026 @10:56PM (#50503858)
Curious why you want to use an LLM for such a task? I’ve built a hobby kernel before because it’s challenging, telling an LLM to implement a feature would get boring fast. Using LLMs at work is different, that’s often not challenging or fun… it’s work, but for hobby coding I just don’t get it.
Re:Nvidia deliberately kept GPU prices high through circular... by mycall on Saturday November 14, 2026 @11:18PM (#50503985)
If using an LLM is boring, then you aren't pushing what you can do with [local] LLMs enough or have an inventor's mindset.
Re:Nvidia deliberately kept GPU prices high through circular... by hadlock on Sunday November 15, 2026 @12:14AM (#50504206)
I realized the other day that for my day job I only need about 10 apps; a good terminal, vs code, chrome, codex/claude sdk, terraform, helm, kubectl, cpython, sops, nvim, email, slack, a generic windowing environment and a handful of other things (linters, templating utilities). Besides having a local container environment, as an SRE I am hoping to have this OS ready to daily drive as my primary work OS. I'm about six weeks in on one of these $200/mo plans and container support is the last feature I need to add before I start doing a performance tuning campaign of the process scheduler and memory handling. Adding these features by hand is interesting, but running my own completely custom OS on bare metal for work is way more satisfying. So far bare metal support is just raspberry pi 3/4/5 but I have risc-v working in an emulator.
Re:Nvidia deliberately kept GPU prices high through circular... by samtheprogram on Saturday November 14, 2026 @10:32PM (#50503723)
[delayed]
Re:Nvidia deliberately kept GPU prices high through circular... by asdfasgasdgasdg on Saturday November 14, 2026 @10:47PM (#50503802)
If it drops to 2000, then it will take 100 months of $20/mo AI subscription to amortize out, not including the time value of money or the cost of running the machine. I don't think this is a good trade for most people.
Re:Nvidia deliberately kept GPU prices high through circular... by ninth_ant on Saturday November 14, 2026 @11:10PM (#50503939)
I can’t argue with your math or conclusion, but the long term price will not be $20/mo when the companies need to start turning a profit.

And if they manage to build a moat the sub price will be even more.

Re:Nvidia deliberately kept GPU prices high through circular... by asdfasgasdgasdg on Sunday November 15, 2026 @08:41AM (#50506876)
That’s what people keep saying. I have my doubts. Open weight models and their lower prices will forever create a ceiling on what AI companies can charge for a given level of intelligence.
Re:Nvidia deliberately kept GPU prices high through circular... by lisplist on Saturday November 14, 2026 @11:19PM (#50503989)
$20 a month subscription won't get you very far with current models, but yeah buying hardware doesn't make sense financially unless you've got it utilized 24/7.
Re:Nvidia deliberately kept GPU prices high through circular... by asdfasgasdgasdg on Sunday November 15, 2026 @08:42AM (#50506882)
It gets me plenty far.
Re:Nvidia deliberately kept GPU prices high through circular... by fionic on Saturday November 14, 2026 @11:42PM (#50504080)
But this doesn’t include token usage? For $20/m there are serious caps on usage limits. I mean I can cap out the usage limit in about an hour and have to wait 4 hours to prompt again then there is the weekly limit. So with local usage your unbound on these time constraints but like others have said there is a power cost.
Re:Nvidia deliberately kept GPU prices high through circular... by hackmack10 on Saturday November 14, 2026 @10:57PM (#50503862)
Flash next sucks compared to Opus 5.5 let alone fable
Re:Nvidia deliberately kept GPU prices high through circular... by oldjohnnylane on Saturday November 14, 2026 @10:59PM (#50503875)
50 something SWE here. I’m happy with a 2015 MacBook Pro. Don’t need Ai at home. Ever. I think you have a misaligned view of the world.
Re:Nvidia deliberately kept GPU prices high through circular... by alexandre_m on Saturday November 14, 2026 @11:06PM (#50503913)
> why would you ever pay for a subscription for your company/family

For convenience mostly.

Why do the majority still continue paying for Netflix et al. when you can have your home media server at home with automatic downloads?

Re:Nvidia deliberately kept GPU prices high through circular... by data-ottawa on Saturday November 14, 2026 @11:43PM (#50504084)
It's worth noting that media piracy is illegal and therefor complicated in most places, requires a lot of manual setup, and people remember seeing fines of tens or hundreds of thousands of dollars.

Installing ollama or lmstudio on a computer with a GPU is about as complicated as installing Netflix. Computers come from the store with GPUs installed and an OS.

Re:Nvidia deliberately kept GPU prices high through circular... by prmoustache on Sunday November 15, 2026 @02:11AM (#50504740)
Outside of dev people typically don't use LLMs on a desktop computer.

To be competitive with frontier offerings, it must be multidevice, available on any network, and integrated with all the apps people are used to use AI with.

Most tech enthusiasts don't self host super trivial things like a local DNS resolver, Their web presence, or email despite the huge incentives and the super low computing requirements, what makes you think they would build and run at least 12/24 a day a dedicated fan buzzing computer (to be useful for the whole family, it can't be the same as the gaming machine) in their home to be available for whatever request their family members may want to do to a model?

Re:Nvidia deliberately kept GPU prices high through circular... by alexandre_m on Sunday November 15, 2026 @10:42AM (#50507767)
I think that AI appliances will become a commodity at some point and people will run this at home.

Things are moving too fast right now, so it’s mostly hobbyists and tech enthusiasts.

Re:Nvidia deliberately kept GPU prices high through circular... by 0x69420 on Saturday November 14, 2026 @11:06PM (#50503914)
at the very least where i come from, engineering types are those who most value privacy, and carry the greatest disdain for direct-to-customer saas in their own personal lives. diy ethic and that. QFN is as dumb as local is ever going to get, and you can run it at acceptable speed on a machine that gets good frames in a ue5 game on high and was built with enough ram for a virtual machine or two.
Re:Nvidia deliberately kept GPU prices high through circular... by brotchie on Saturday November 14, 2026 @11:08PM (#50503925)
$200 / month is getting you access to frontier models that can't run on a $2000 GPU and let's you run lots of things in parallel. I'll very often run swarms of 10-20 agents that I couldn't possibly run locally without likely $100k-$1m of local compute?

Essentially is the same as "why use the Cloud" argument.

I could 100% see myself wanting local inference for some local use-cases: continuously monitoring my network for intrusions, checking my security cameras every few seconds, running long running video generation models, etc.

Re:Nvidia deliberately kept GPU prices high through circular... by drnick1 on Sunday November 15, 2026 @12:14AM (#50504205)
> Essentially is the same as "why use the Cloud" argument.

The case is much stronger. You can run pretty much every "cloud service" out there at home on hardware that is practically e-junk. It really does not take much to serve webpages, host email, or a fileserver. In all cases you get something better than a commercial solution.

Re:Nvidia deliberately kept GPU prices high through circular... by visarga on Sunday November 15, 2026 @01:48AM (#50504607)
And if you use your AI to set that up - because people complain the level of friction to keep such solutions working, then you can make your AI costs back in cloud costs.
Re:Nvidia deliberately kept GPU prices high through circular... by octoberfranklin on Saturday November 14, 2026 @11:32PM (#50504044)
Maybe say "Qwen Flash Next" a few more times for emphasis.
Re:Nvidia deliberately kept GPU prices high through circular... by adrianN on Sunday November 15, 2026 @12:07AM (#50504173)
Putting 2k in a 3% savings account already pays for three $20 months. Include the rest of the hardware around the gpu and electricity costs and you never save money by running your own hardware. Which makes perfect sense, since cloud providers have cheaper electricity and can use hardware more efficiently by running it at higher load. The reasons to run inference locally will never be economic. Perhaps we will reach the point where it becomes cheap enough not to matter so that nonmonetary considerations win.
Re:Nvidia deliberately kept GPU prices high through circular... by sysmax on Sunday November 15, 2026 @12:37AM (#50504303)
If you run it at home, it won't be realistically doing it 24/7. 8 hours per day is already 33% utilization. If the model is actually running half of that time, it's already 15%.

So, there will be always business for someone to host one in a data center, and sell the tokens at a markup, that will still be cheaper than buying something you will only use 15% of the time.

I don't think it's currently possible to calculate a reasonable valuation for an AI company using conventional techniques. It is too new, it is still rapidly evolving, nobody knows how it will reshape the industry. It's more of a poker game where the underwriters are betting on how much the investors are willing to throw into a perceived once-in-20-years oportunity.

Re:Nvidia deliberately kept GPU prices high through circular... by ctkhn on Sunday November 15, 2026 @12:47AM (#50504345)
There's a lot of use cases where you may not be personally interacting constantly but the LLM is running a lot of the time. A consumer-hostable model like qwen3.8 flash next take longer than opus or better models to complete software builds, and I set mine off before bed, before work, and over lunch to take the next stage of some feature. It is running pretty consistently, just over more time than if it ran on the more powerful datacenter hardware that we use at work.
Re:Nvidia deliberately kept GPU prices high through circular... by sysmax on Sunday November 15, 2026 @01:20AM (#50504482)
The math still doesn't add up.

Let's say, you get 80 tokens/sec, so 80 * 3600 * 24 = ~7M tokens or $3.3/day at the current OpenRouter token pricing. That's ~2 years to break even at $2000.

That's also about 7kWh/day assuming 300W, so net $2/day or ~3 years. Given how fast the hardware changes, it makes no sense at all.

Also, in my experience, Qwen 3.8 heavily relies on reasoning to produce meaningful results. So where Gemini-Flash would just give you a usable result in like 5 seconds, Qwen would stumble on a trivial technicality (like completely forget '+' and '-' in a patch), then reason for a minute or two on "hey, but what about that requirement, maybe it is related"? and eventually come to the right answer. But the speed and the token use is abysmal.

I mean, it's a cool model and it's a big step, and it's crucial to have open-weight AI, but currently it's not practical beyond proof-of-concept.

Re:Nvidia deliberately kept GPU prices high through circular... by ofrzeta on Sunday November 15, 2026 @01:39AM (#50504575)
I get quite all my work done with Claude Pro, which is around $20 a month, even using it at work. I could subscribe to this for 10 years until breaking even with your fictitious $2000 RTX 6000. Economically this just doesn't make sense.
Re:Nvidia deliberately kept GPU prices high through circular... by jeffy29 on Sunday November 15, 2026 @01:48AM (#50504610)
Incredible what one can achieve with fantasy math and leaps in logic
Re:Nvidia deliberately kept GPU prices high through circular... by sleight42 on Sunday November 15, 2026 @01:58AM (#50504663)
If it dropped to 2,000, I'd rebuild my server all over again with 384GB vram.

DSV4.1F is enough.

Re:Nvidia deliberately kept GPU prices high through circular... by cantalopes on Sunday November 15, 2026 @03:05AM (#50505009)
I known 0 "normies" that work on a desktop computer, or that would even remotely care to invest 2k upfront to not pay for ai subscription, or have a tiniest effort cpaacity to learn how to install it.

Why do you think everyone still pays for icloud or google drive instead of just self gosting a foss on nas at home? Hell, even me as an engineer know how to do it and know i would save money but i just can't be bothered because of convenience

Re:Nvidia deliberately kept GPU prices high through circular... by AnnikaL on Sunday November 15, 2026 @03:37AM (#50505148)
Isn't the lesson of "640k is enough for anyone" that people will end up wanting more? Nobody today will buy a computer with 640KB of RAM, even though surely this would be cheaper.
Re:Nvidia deliberately kept GPU prices high through circular... by PaulKeeble on Sunday November 15, 2026 @07:32AM (#50506474)
With Strata and the other inference engines designed for these moderate sized MOE models its more about RAM than it is the GPU. Qwen Flash Next will run on a fairly typical 12-16GB consumer card at 50 tok/s but you need 64GB to hold the weights of the experts in the model with NGRAM coming off the SSD. A blackwell GPU will run it faster but you can get a good experience with Qwen flash next at 2-4 bit quant mostly on RAM.
Re:Nvidia deliberately kept GPU prices high through circular... by hadlock on Sunday November 15, 2026 @02:33PM (#50509903)
Agreed, almost nobody needs the ability to run 60 gpu workloads concurrently, unfortunately nvidia refuses to sell a competing product with 64, 96, 128gb vram
Re:Nvidia deliberately kept GPU prices high through circular... by bdelmas on Sunday November 15, 2026 @10:40AM (#50507746)
Thinking that the RTX 6000 can go from $8000 to $2000 just like that is beyond any reality and shows a lack of basic grasp of how (GPU) prices evolve. Even with almost perfect economic conditions, it will take a couple of years... And we're way off even average economic conditions.
Re:Nvidia deliberately kept GPU prices high through circular... by DiskoHexyl on Sunday November 15, 2026 @07:05PM (#50512317)
It’s the other way around- the engineering types know the limits of a smaller model and will coordinate their tasks accordingly.

A normal user, on the other hand, knows nothing and will be disappointed after finding out that a local model doesn’t keep up with a month-long conversation, sucks at searching the web, makes way more logical errors and requires better directions than chat gpt.

Coding is way easier for a smaller open-weight model than navigating real-life issues

Re:Nvidia deliberately kept GPU prices high through circular... by xnx on Monday November 16, 2026 @12:36AM (#50514397)
If hardware becomes cheaper, so will subscriptions.