Just sidenote, this experience can be replicated with software like Paseo or some other options.
I usually have a frontier model orchestrating between dumber frontier, Chinese, and local models, using Paseo subagents, from my phone or whatever hardware I'm near.
Though I don't lean too much on the local models, I find them to simply be too stupid. They're fun for experiments though like quizzing them against Wikipedia or making them debate philosophy in loops.
The strongest case for local AI is for anything requiring privacy/discretion but I don't think individuals will collectively prioritize this. Convenience is king for the majority followed closely by cost. Businesses who care about protecting their competitive edge seem like the more likely candidates for local AI but only if ZDR providers aren't good enough.
Local AI will probably end up where it is now: in the hands of hobbyists and/or privacy-minded people who already own a GPU for gaming.
Despite everything we know about the attention economy the self-hosted community is still a niche group of tech-minded hobbyists. Running anything locally is a commitment and adding expensive hardware to the mix is an even higher barrier.
I want people to care about privacy, technology, and interoperability but I'm just not seeing it happen.
I would bet good money that my $20/month subscriptions are not going to become ad-ridden.
If someone wants to use the free tiers, then nobody is going to be surprised if they see ads.
But these claims that my $20/month plan are going to become “ad-ridden” are at odds with what is happening. I’ve had at least $20/month plans from OpenAI and Anthropic for about as long as they’ve been available, and the quality and amount of inference I get from even the lowest tier are increasing all the time.
At this point, I can run Luna/xhigh on the $20 plan almost constantly (with brief breaks for tool calls doing actual work, not just token generation for fun) and it feels endless. In another 24 months we’ll be doing even higher quality outputs with smaller hosted models on faster cloud hardware and it’s going to be available from many different providers.
The doomsaying about “ad ridden” should be kept to the free plans. It’s just not going to happen on $20/month
Because, unlike the $20 Claude subscription, your own hardware will not respond "sorry, but I cannot do that" when you try to hack a device or game that you own.
And that $20 subscription isn't a good comparison. That gets you Astra or Opus. Better comparison is OpenAI's $8/month plan, which gets you Luna (which scores the same as Qwen on benchmarks). At that price, most of the cost isn't even the model; it's just hosting the infrastructure.
The same thing happened with uber when they needed to start making money. It's only competition that stopped it from increasing more.
AI startups are characterized by:
1) Market dumping. They are burning investor capital to buy market share.
2) A need to constantly raise money to pay for (1).
A Chapter 11 bankruptcy would make no sense in this situation. They haven't demonstrated that their business model is viable, so if a court ordered a Chapter 11 these firms would just immediately go bankrupt again, and that's usually a criteria to require a different and harsher kind of bankruptcy.
But even if for some reason a court did allow it, they'd still need to do emergency raises because their outgoings are so high. Debt has nothing to do with that, it's purely a matter of fixed costs and (in Anthropic's case at least) huge locked in contracts. But no investor is going to give money to a company that just permanently defaulted on them and ran to court to zero out the value of those shares. So they would be unable to raise and would immediately go bankrupt again.
The reason they’re entering compute contracts is because every dollar they spend on compute for serving their plans (inference) produces more dollars of revenue.
Models are getting better. Serving hardware is getting faster. Fabs are being produced to make more hardware.
Things will only get cheaper and more plentiful from here.
Local vs rented vs token pricing all fall at similar rates, though.
Why would any of those non-power-users buy a $2000 GPU that doubles as a space heater (seriously, try sitting next to one during long runs in the summer) and thousands more for a computer to host it, plus all of the trouble of setting it up, instead of a $20/month subscription?
I do have the hardware to run Qwen3.8-Flash-Next at home, and I still heavily use my subscriptions even for simple tasks. The experience of using the apps on my phone on the go is great and I always have the option to scale the model up to the task.
The people who are going to pay thousands of dollars up front to avoid $20 are power users and people who have different priorities and motivations, like independence or ultimate privacy. GPU prices dropping won’t change that much.
Also, you don’t need an RTX6000 for Q3.8FN. There are much cheaper options right now at lower speeds.