See also: https://github.com/niko1221/strata
That's at or below cost. Nvidia would just stop making them. Of course used cards will reach that price ten years from now.
Why would any of those non-power-users buy a $2000 GPU that doubles as a space heater (seriously, try sitting next to one during long runs in the summer) and thousands more for a computer to host it, plus all of the trouble of setting it up, instead of a $20/month subscription?
I do have the hardware to run Qwen3.8-Flash-Next at home, and I still heavily use my subscriptions even for simple tasks. The experience of using the apps on my phone on the go is great and I always have the option to scale the model up to the task.
The people who are going to pay thousands of dollars up front to avoid $20 are power users and people who have different priorities and motivations, like independence or ultimate privacy. GPU prices dropping won’t change that much.
Also, you don’t need an RTX6000 for Q3.8FN. There are much cheaper options right now at lower speeds.
Just sidenote, this experience can be replicated with software like Paseo or some other options.
I usually have a frontier model orchestrating between dumber frontier, Chinese, and local models, using Paseo subagents, from my phone or whatever hardware I'm near.
Though I don't lean too much on the local models, I find them to simply be too stupid. They're fun for experiments though like quizzing them against Wikipedia or making them debate philosophy in loops.
The strongest case for local AI is for anything requiring privacy/discretion but I don't think individuals will collectively prioritize this. Convenience is king for the majority followed closely by cost. Businesses who care about protecting their competitive edge seem like the more likely candidates for local AI but only if ZDR providers aren't good enough.
Local AI will probably end up where it is now: in the hands of hobbyists and/or privacy-minded people who already own a GPU for gaming.
Despite everything we know about the attention economy the self-hosted community is still a niche group of tech-minded hobbyists. Running anything locally is a commitment and adding expensive hardware to the mix is an even higher barrier.
I want people to care about privacy, technology, and interoperability but I'm just not seeing it happen.
I would bet good money that my $20/month subscriptions are not going to become ad-ridden.
If someone wants to use the free tiers, then nobody is going to be surprised if they see ads.
But these claims that my $20/month plan are going to become “ad-ridden” are at odds with what is happening. I’ve had at least $20/month plans from OpenAI and Anthropic for about as long as they’ve been available, and the quality and amount of inference I get from even the lowest tier are increasing all the time.
At this point, I can run Luna/xhigh on the $20 plan almost constantly (with brief breaks for tool calls doing actual work, not just token generation for fun) and it feels endless. In another 24 months we’ll be doing even higher quality outputs with smaller hosted models on faster cloud hardware and it’s going to be available from many different providers.
The doomsaying about “ad ridden” should be kept to the free plans. It’s just not going to happen on $20/month
Because, unlike the $20 Claude subscription, your own hardware will not respond "sorry, but I cannot do that" when you try to hack a device or game that you own.
And that $20 subscription isn't a good comparison. That gets you Astra or Opus. Better comparison is OpenAI's $8/month plan, which gets you Luna (which scores the same as Qwen on benchmarks). At that price, most of the cost isn't even the model; it's just hosting the infrastructure.
The same thing happened with uber when they needed to start making money. It's only competition that stopped it from increasing more.
AI startups are characterized by:
1) Market dumping. They are burning investor capital to buy market share.
2) A need to constantly raise money to pay for (1).
A Chapter 11 bankruptcy would make no sense in this situation. They haven't demonstrated that their business model is viable, so if a court ordered a Chapter 11 these firms would just immediately go bankrupt again, and that's usually a criteria to require a different and harsher kind of bankruptcy.
But even if for some reason a court did allow it, they'd still need to do emergency raises because their outgoings are so high. Debt has nothing to do with that, it's purely a matter of fixed costs and (in Anthropic's case at least) huge locked in contracts. But no investor is going to give money to a company that just permanently defaulted on them and ran to court to zero out the value of those shares. So they would be unable to raise and would immediately go bankrupt again.
The reason they’re entering compute contracts is because every dollar they spend on compute for serving their plans (inference) produces more dollars of revenue.
Models are getting better. Serving hardware is getting faster. Fabs are being produced to make more hardware.
Things will only get cheaper and more plentiful from here.
Local vs rented vs token pricing all fall at similar rates, though.
deepseek can run locally on my strix halo and handles this kind of thing just fine. it really is good enough already for hands off programming, and hands on looping for slightly more complex stuff.
The normies are not going to pay $2000 upfront just to use AI lol. Why would they?
This is a weird comparison to make, because 640k is known mostly because of how wrong this prediction was. It turned out that people wanted more, and the more RAM was available the more RAM hungry applications were created. So probably the opposite of what you meant (that Qwen will be enough for most).
To be fair, you wouldn't use an LLM for this.
I use LLMs for code review a lot, didn't try Qwen Flast Next but the bigger models do give better reviews so just having this case probably won't apply to me.
And if they manage to build a moat the sub price will be even more.
For convenience mostly.
Why do the majority still continue paying for Netflix et al. when you can have your home media server at home with automatic downloads?
Installing ollama or lmstudio on a computer with a GPU is about as complicated as installing Netflix. Computers come from the store with GPUs installed and an OS.
To be competitive with frontier offerings, it must be multidevice, available on any network, and integrated with all the apps people are used to use AI with.
Most tech enthusiasts don't self host super trivial things like a local DNS resolver, Their web presence, or email despite the huge incentives and the super low computing requirements, what makes you think they would build and run at least 12/24 a day a dedicated fan buzzing computer (to be useful for the whole family, it can't be the same as the gaming machine) in their home to be available for whatever request their family members may want to do to a model?
Things are moving too fast right now, so it’s mostly hobbyists and tech enthusiasts.
Essentially is the same as "why use the Cloud" argument.
I could 100% see myself wanting local inference for some local use-cases: continuously monitoring my network for intrusions, checking my security cameras every few seconds, running long running video generation models, etc.
The case is much stronger. You can run pretty much every "cloud service" out there at home on hardware that is practically e-junk. It really does not take much to serve webpages, host email, or a fileserver. In all cases you get something better than a commercial solution.
So, there will be always business for someone to host one in a data center, and sell the tokens at a markup, that will still be cheaper than buying something you will only use 15% of the time.
I don't think it's currently possible to calculate a reasonable valuation for an AI company using conventional techniques. It is too new, it is still rapidly evolving, nobody knows how it will reshape the industry. It's more of a poker game where the underwriters are betting on how much the investors are willing to throw into a perceived once-in-20-years oportunity.
Let's say, you get 80 tokens/sec, so 80 * 3600 * 24 = ~7M tokens or $3.3/day at the current OpenRouter token pricing. That's ~2 years to break even at $2000.
That's also about 7kWh/day assuming 300W, so net $2/day or ~3 years. Given how fast the hardware changes, it makes no sense at all.
Also, in my experience, Qwen 3.8 heavily relies on reasoning to produce meaningful results. So where Gemini-Flash would just give you a usable result in like 5 seconds, Qwen would stumble on a trivial technicality (like completely forget '+' and '-' in a patch), then reason for a minute or two on "hey, but what about that requirement, maybe it is related"? and eventually come to the right answer. But the speed and the token use is abysmal.
I mean, it's a cool model and it's a big step, and it's crucial to have open-weight AI, but currently it's not practical beyond proof-of-concept.
DSV4.1F is enough.
Why do you think everyone still pays for icloud or google drive instead of just self gosting a foss on nas at home? Hell, even me as an engineer know how to do it and know i would save money but i just can't be bothered because of convenience
A normal user, on the other hand, knows nothing and will be disappointed after finding out that a local model doesn’t keep up with a month-long conversation, sucks at searching the web, makes way more logical errors and requires better directions than chat gpt.
Coding is way easier for a smaller open-weight model than navigating real-life issues
Engineering types and power users need not apply,but For Everyone Else, the "normies", Qwen Flash Next is probably "640k is enough for anyone" territory.
IPO, valuation etc depend heavily on frontier, or "good enough" AI to need to run on commercial grade GPUs. If Qwen Flash Next is good enough and runs on a $2000 GPU, why would you pay $20/30/100/200 per month in perpetuity?
I wouldn't pick Qwen Flash Next to add kernel namespacing and cgroups v2 to my custom OS kernel, but it will happily implement the Plan.md that Fable 5.2 wrote for a dollar.