News for hackers. Stuff that matters.
Re:Outsourcing plus LocalAI will soon become more economical... by alfiedotwtf on Tuesday May 26, 2026 @12:07PM (#48281655)
Incentives matter…

If prices keep going up, watch for companies to exit frontier models and go to local llama.cpp instances for 6-month-ago SOTA, with the flex of being housed within the office - no more privacy leakage, no more price gouging.

To be honest, I’m not sure why a Y-Combinator backed company hasn’t come out yet flooding the market with highly capable OPAI (pronounced “Oh-pah” as in what Greeks shout as the drink shots), which stands for “On-Prem AI”

… yes, I just made up OPAI right now lol

Re:Outsourcing plus LocalAI will soon become more economical... by overfeed on Tuesday May 26, 2026 @02:44PM (#48284026)
> I’m not sure why a Y-Combinator backed company hasn’t come out yet flooding the market with highly capable OPAI

If we momentarily disregard the fact that YC itself owns billions of dollars worth of OpenAI shares[1], YC would plan to find demo-day investors willing to drive down the value of frontier labs. The coöpetition among VCs and the existing web of AI investments will mean no VC will be interested in investing in local AI...until after the frontier labs IPO.

1. Thanks to the self-dea^w foresight of former YC president Sam Altman

Re:Outsourcing plus LocalAI will soon become more economical... by runtime_terror on Tuesday May 26, 2026 @03:57PM (#48285163)
I do think many will move to lower cost models or self hosted over the next few years as prices balloon. And the privacy/control story is compelling.

If we're able to see some big increases in hardware capabilities that can be self-hosted, that will be an accelerant.

That said, most companies just want to pay a provider to delegate responsibility in exchange for cost and control.

Re:Outsourcing plus LocalAI will soon become more economical... by nicoburns on Tuesday May 26, 2026 @04:07PM (#48285281)
> If prices keep going up, watch for companies to exit frontier models and go to local llama.cpp instances for 6-month-ago SOTA, with the flex of being housed within the office - no more privacy leakage, no more price gouging.

That or just hiring people to do the work! I hear rumours that this is already starting to happen in some places (perhaps those that were a little overzealous with AI-hype driven layoffs).

Re:Outsourcing plus LocalAI will soon become more economical... by alfiedotwtf on Tuesday May 26, 2026 @06:17PM (#48286761)
Fool me once… I think applying for jobs at a company that only within the last 12 months shed thousands of people “because of AI” should be seen as laughable, and employees collectively rejecting to work there should be seen as the norm