News for hackers. Stuff that matters.
Re:Apple has new Mac app coming to make running local AI mod... by criley2 on Wednesday November 11, 2026 @07:28AM (#50452640)
Totally disagree. I do not think local models will displace cloud models any time soon, and I think distillation has been demonstrated to NOT have better performance and is LESS efficient. Chinese models use dramatically more tokens and time to achieve dramatically inferior results. Watching deepseek spit out 20M tokens when Opus solves in <1M is always an entertaining window into "efficiency" and "performance".

Local models literally cost more in electricity than using far more powerful cloud models cost in inference.

When your options are "dramatically drain your iPhone battery for substandard AI, or have instantaneous cloud AI with no battery drain" what do you think the average user will choose?

And that's before we discuss how ridiculous the pricing is for home hardware that has a chance of running a halfway decent model at a halfway decent speed.

I think the future prospects for local AI are looking worse than ever. It will be far more expensive for a far worse experience for the foreseeable future.

There are no comments on this comment yet.