News for hackers. Stuff that matters.
Re:Outsourcing plus LocalAI will soon become more economical... by runtime_terror on Tuesday May 26, 2026 @11:53AM (#48281455)
> The subscription token price is 10x-40x cheaper than API pricing

This is a temporary phenomenon. Expect either drastic price increases or draconian throttling or both in the coming months.

These companies are operating at huge loses and have hundreds of billions in liabilities and commitments. They need to turn on the money faucet sooner than later.

Re:Outsourcing plus LocalAI will soon become more economical... by Npovview on Tuesday May 26, 2026 @12:08PM (#48281660)
Even with increased prices, AI enables velocity both in development and bugs fixing. Would companies want that? If prices are biting the company, I think companies will route all development and bugs fixing requests through few superperfomer developers with complete knowledge of the different components within the company (they will be the Queen Bees holding the company on their head). The rest of the company will be tasked with requirment gathering, specs cleaning, deambiguation and so on (worker bees).
Re:Outsourcing plus LocalAI will soon become more economical... by DougN7 on Tuesday May 26, 2026 @02:34PM (#48283883)
From what I understand, that is sort of how IBM Bob works - multiple models behind the scenes and they route the request to the model that will handle it best at the lowest price.
Re:Outsourcing plus LocalAI will soon become more economical... by runtime_terror on Tuesday May 26, 2026 @03:55PM (#48285127)
So kinda like how stuff is now at a lot of big companies? I've worked at many different companies and almost always there are a few out-performers and a lot of people just found enough not to get fired (no hate, power to them lol).

We're already seeing slash their AI budgets. I expect that will increase till we hit more of an equilibrium.

Re:Outsourcing plus LocalAI will soon become more economical... by Npovview on Wednesday May 27, 2026 @10:05AM (#48294594)
I think people will start measuring (features * time taken to implement) to tokens consumed ratio and then redistribute token budgets to developers. This will measure how effective/efficient people are LLMs.
Re:Outsourcing plus LocalAI will soon become more economical... by curt15 on Tuesday May 26, 2026 @08:23PM (#48287856)
> Even with increased prices, AI enables velocity both in development and bugs fixing.

What about human understanding of the codebase that's essential to any project's long term health? Even "superperformer developers" eventually leave the company.

Re:Outsourcing plus LocalAI will soon become more economical... by Npovview on Wednesday May 27, 2026 @09:57AM (#48294464)
Ask multiple AIs (if you can't trust one) to explain the project.
Re:Outsourcing plus LocalAI will soon become more economical... by 0xbadcafebee on Tuesday May 26, 2026 @09:44PM (#48288426)
Most software development teams are pushing back on the deluge of bad changes from AI tools and are moving slower again to regain trust and stability. It is likely that future software development will not actually be higher velocity.
Re:Outsourcing plus LocalAI will soon become more economical... by Npovview on Tuesday May 26, 2026 @10:20PM (#48288684)
Bad changes will be eliminated because better people are using the AI tools. They will reduce cost as well as slop.
Re:Outsourcing plus LocalAI will soon become more economical... by 0xbadcafebee on Wednesday May 27, 2026 @07:41AM (#48292723)
The models are the same whether you're smart or dumb
Re:Outsourcing plus LocalAI will soon become more economical... by kakacik on Wednesday May 27, 2026 @08:32AM (#48293271)
Yes and we will all hold hands together singing and bring world peace from now on forever. Back in reality, I can see some obstacles without even trying
Re:Outsourcing plus LocalAI will soon become more economical... by Npovview on Wednesday May 27, 2026 @10:11AM (#48294703)
Do you want 60% of people to be employed in farming? I am being rhetorical because that is what you sarcasm implies. Today only 2% of people in farming support so many people in America.
Re:Outsourcing plus LocalAI will soon become more economical... by otabdeveloper4 on Wednesday May 27, 2026 @06:54AM (#48292293)
> AI enables velocity both in development and bugs fixing

Or so they say. You'll have to trust those vibes blindly, because double-checking these claims apparently makes you an anti-science luddite.

Re:Outsourcing plus LocalAI will soon become more economical... by alfiedotwtf on Tuesday May 26, 2026 @12:07PM (#48281655)
Incentives matter…

If prices keep going up, watch for companies to exit frontier models and go to local llama.cpp instances for 6-month-ago SOTA, with the flex of being housed within the office - no more privacy leakage, no more price gouging.

To be honest, I’m not sure why a Y-Combinator backed company hasn’t come out yet flooding the market with highly capable OPAI (pronounced “Oh-pah” as in what Greeks shout as the drink shots), which stands for “On-Prem AI”

… yes, I just made up OPAI right now lol

Re:Outsourcing plus LocalAI will soon become more economical... by overfeed on Tuesday May 26, 2026 @02:44PM (#48284026)
> I’m not sure why a Y-Combinator backed company hasn’t come out yet flooding the market with highly capable OPAI

If we momentarily disregard the fact that YC itself owns billions of dollars worth of OpenAI shares[1], YC would plan to find demo-day investors willing to drive down the value of frontier labs. The coöpetition among VCs and the existing web of AI investments will mean no VC will be interested in investing in local AI...until after the frontier labs IPO.

1. Thanks to the self-dea^w foresight of former YC president Sam Altman

Re:Outsourcing plus LocalAI will soon become more economical... by runtime_terror on Tuesday May 26, 2026 @03:57PM (#48285163)
I do think many will move to lower cost models or self hosted over the next few years as prices balloon. And the privacy/control story is compelling.

If we're able to see some big increases in hardware capabilities that can be self-hosted, that will be an accelerant.

That said, most companies just want to pay a provider to delegate responsibility in exchange for cost and control.

Re:Outsourcing plus LocalAI will soon become more economical... by nicoburns on Tuesday May 26, 2026 @04:07PM (#48285281)
> If prices keep going up, watch for companies to exit frontier models and go to local llama.cpp instances for 6-month-ago SOTA, with the flex of being housed within the office - no more privacy leakage, no more price gouging.

That or just hiring people to do the work! I hear rumours that this is already starting to happen in some places (perhaps those that were a little overzealous with AI-hype driven layoffs).

Re:Outsourcing plus LocalAI will soon become more economical... by alfiedotwtf on Tuesday May 26, 2026 @06:17PM (#48286761)
Fool me once… I think applying for jobs at a company that only within the last 12 months shed thousands of people “because of AI” should be seen as laughable, and employees collectively rejecting to work there should be seen as the norm
Re:Outsourcing plus LocalAI will soon become more economical... by anthonypasq on Tuesday May 26, 2026 @12:02PM (#48281573)
Theres recent reporting that Anthropic will be profitable this quarter...

edit: I see in other comments on this thread you think Ed Zitron is a reliable pundit so that explains everything.

Re:Outsourcing plus LocalAI will soon become more economical... by runtime_terror on Tuesday May 26, 2026 @03:59PM (#48285192)
How will it be profitable, really?

You can dismiss Ed (and me vicariously) but what's your compelling evidence to counter their extremely uphill battle towards profitability?

Either way it will be very interesting to see their S1 when they try and IPO.

If it's anything like SpaceX's then I suspect my post will age better than yours.

Re:Outsourcing plus LocalAI will soon become more economical... by brookst on Tuesday May 26, 2026 @10:13PM (#48288638)
I sincerely doubt Anthropic’s IPO will say that their AI business is only 2% of their future revenue, and they’re bundling in totally unrelated, unprofitable things they expect to account for 98%.
Re:Outsourcing plus LocalAI will soon become more economical... by runtime_terror on Wednesday May 27, 2026 @12:10PM (#48296397)
I'm not sure what you're talking about or referring to...

I haven't heard anyone claim their S1 will show that but that it will show how poorly their revenue figures look against their costs.

Re:Outsourcing plus LocalAI will soon become more economical... by brookst on Wednesday May 27, 2026 @12:37PM (#48296767)
Space'x IPO docs say that launch + Starlink will be 2% of their revenue opportunity, with enterprise AI being 98%.
Re:Outsourcing plus LocalAI will soon become more economical... by runtime_terror on Sunday May 31, 2026 @11:53PM (#48352436)
Ah yes I see, SpaceXs IPO is a thing of beauty in how insane it is.
Re:Outsourcing plus LocalAI will soon become more economical... by 8note on Wednesday May 27, 2026 @01:51AM (#48290196)
the alternative is that api prices change to be more in line with deepseek's
Re:Outsourcing plus LocalAI will soon become more economical... by runtime_terror on Wednesday May 27, 2026 @12:08PM (#48296361)
So then how do these companies return profits to investors?
Re:Outsourcing plus LocalAI will soon become more economical... by tomaskafka on Thursday May 28, 2026 @06:48AM (#48307150)
Here is the fun part: they don’t