News for hackers. Stuff that matters.
Re:Apple has new Mac app coming to make running local AI mod... by tonymet on Tuesday November 10, 2026 @07:13PM (#50448149)
Why so much investment in local models when the remote ones are so cheap ? Everyone was fine with remote compute & storage before AI, now they balk?
Re:Apple has new Mac app coming to make running local AI mod... by t-3 on Tuesday November 10, 2026 @07:35PM (#50448330)
Cheap remote is probably not going to last forever. Memory prices will eventually drop. Local models will be more than enough for many purposes when the hardware is available cheaply enough.
Re:Apple has new Mac app coming to make running local AI mod... by tonymet on Tuesday November 10, 2026 @07:42PM (#50448382)
that's a lot of ifs / whens , and the remote models work right now, and are cheap. It's not a gym membership.
Re:Apple has new Mac app coming to make running local AI mod... by nier on Tuesday November 10, 2026 @11:01PM (#50449606)
People and organizations have requirements that their data stays on their devices or at least in their networks.
Re:Apple has new Mac app coming to make running local AI mod... by tonymet on Wednesday November 11, 2026 @12:30AM (#50450026)
i agree that's a benefit, but we've had that requirement for 40+ years and managed with cloud too.
Re:Apple has new Mac app coming to make running local AI mod... by nier on Wednesday November 11, 2026 @03:22AM (#50450934)
While I might imagine that there are customers who would store their data in the cloud but not necessarily run inference on it, there are also those who have strict rules against any cloud-based service. Those are the ones I’m talking about.
Re:Apple has new Mac app coming to make running local AI mod... by mbgerring on Wednesday November 11, 2026 @05:37AM (#50451838)
Some of us were never fine with remote compute or storage.
Re:Apple has new Mac app coming to make running local AI mod... by tonymet on Wednesday November 11, 2026 @02:45PM (#50457621)
I understand the reluctance, but the cost equation is inverted.

Compute & storage were cheap, so renting them was expensive for many applications.

Inference is expensive. Just getting started is 4-5 figures. Why not rent it for pennies.