News for hackers. Stuff that matters.
Re:Apple has new Mac app coming to make running local AI mod... by nomel on Tuesday November 10, 2026 @05:31PM (#50447239)
Cloud compute has been completely commoditized. Yes, local models will get better and better, but I think for the vast majority, it will continue to be both cheaper and more productive to use cloud based models, far into the future, where bulk purchasing, oversubscription, and discounted industrial electric rates can be taken advantage of.

Where I am, it's cheaper to purchase multiple claude subscriptions than it is for the power bill from running a local model. Factor in the hardware costs, and you're looking at a break even a decade in the future. Yes, there's privacy, etc, but now you're down into fractions of a percent of users.

Re:Apple has new Mac app coming to make running local AI mod... by xnx on Tuesday November 10, 2026 @05:52PM (#50447433)
And if you're on a mobile device, any halfway powerful local model is going to cut your battery life way down.
Re:Apple has new Mac app coming to make running local AI mod... by nomel on Tuesday November 10, 2026 @06:10PM (#50447624)
Related, I tried Juggernaut XL (image model) on my iPhone, and ate 2% battery per image!
Re:Apple has new Mac app coming to make running local AI mod... by walthamstow on Wednesday November 11, 2026 @04:56AM (#50451557)
Gemma 4 E4B on Pixel 10 Pro is a great way to keep your hands warm in the cold