News for hackers. Stuff that matters.
Re:Apple has new Mac app coming to make running local AI mod... by KolibriFly on Wednesday November 11, 2026 @07:24AM (#50452602)
Calculate the total cost of two new Mac Studios with max memory and cables. For that budget you could burn tokens on cloud APIs for a long time or build a dedicated server on open hardware with clear server buses
Re:Apple has new Mac app coming to make running local AI mod... by DerDerDaIst on Wednesday November 11, 2026 @07:29AM (#50452644)
devise the cost by the burnrate with cloud ai and you know when you'll break even. Add a bonus for the privacy.

Another bonus: Here in Germany a huge chunk of the hardware cost can be deducted from the tax bill.

Re:Apple has new Mac app coming to make running local AI mod... by _1 on Wednesday November 11, 2026 @07:29AM (#50452651)
Two new Mac Studios come with privacy.
Re:Apple has new Mac app coming to make running local AI mod... by hello5010 on Wednesday November 11, 2026 @07:32AM (#50452666)
> For that budget you could burn tokens on cloud APIs for a long time or build a dedicated server on open hardware with clear server buses

Let the market decide.

Seems like enterprises and individual users are slowly switching to local models.

Sucks to be Member of Technical staff at OAI/ANT.

Re:Apple has new Mac app coming to make running local AI mod... by bel8 on Wednesday November 11, 2026 @08:54AM (#50453455)
> Seems like both enterprises and individual users are switching to local models.

I know a total of zero and individuals or companies using local inference for their workhorse inference.

Local models are just not up to most tasks for now at least.

Re:Apple has new Mac app coming to make running local AI mod... by CharlieDigital on Wednesday November 11, 2026 @11:41AM (#50455426)
I take poster's usage of "local" to mean "self-hosted" which would include Revolut switching to self hosted GLM (which I think we'll see more of)
Re:Apple has new Mac app coming to make running local AI mod... by tencentshill on Wednesday November 11, 2026 @09:15AM (#50453696)
Do you think the cost of cloud tokens will stay the same or go down over the next ~5 years? Not likely, especially as the big ones start IPOs.
Re:Apple has new Mac app coming to make running local AI mod... by no-name-here on Sunday November 15, 2026 @03:38AM (#50505152)
> next ~5 years

Haven’t token prices been falling by like 75% per year? I guess you’re saying that after IPO they will stop trying to be competitive with all the cloud providers that host open models?

Re:Apple has new Mac app coming to make running local AI mod... by justauserid on Thursday November 12, 2026 @12:48AM (#50463536)
There are two use cases where this is useful:

1. privacy (w.r.t. personal data, human agency, IP, whatever) – this is absolutely is the most crucial.

2. if the needs are absolutely sufficed with local model(s) runnable on a super-expensive mac with a whole lot of RAM and the equivalent cost on API/subscription would be at least few times (say 2-3x) considering machine repair/maintainence/etc

There's a 3rd case thoguh – the hobbylist case, which, imho and in my anecdotal evidence, is the majority of local-model-chasing outside of enterprise (which is usually not hobbyist to begin with).

So there of couse are three legit use-cases.