News for hackers. Stuff that matters.
Re:Apple has new Mac app coming to make running local AI mod... by Aurornis on Wednesday November 11, 2026 @01:27AM (#50450300)
> Would that imply the entry-level MacBook will have 128GB

Most people neither need nor want to run large LLMs locally.

The entry level MacBook Neo costs $599. Even if RAM prices revert to the pre-AI mean, the entry level models are not going to be that stacked with RAM.

Eventually we'll get to a doubling where entry level means 16GB of RAM, but most people won't be running anything more than simple models for light local work.

Have you ever tried running large LLMs on a MacBook Pro? It's hot, loud, and makes your battery level disappear at rates you didn't know were possible if you're not plugged in. It's a very niche hobby.

Re:Apple has new Mac app coming to make running local AI mod... by usrnm on Wednesday November 11, 2026 @02:35AM (#50450712)
> Most people neither need nor want to run large LLMs locally

I'm old enough to remember the time when most people neither needed nor wanted a phone with a large screen and no buttons

Re:Apple has new Mac app coming to make running local AI mod... by AdamN on Wednesday November 11, 2026 @03:16AM (#50450908)
I'm old enough to remember in NYC when people knew the number of their local car service and that tools like Uber were 'dumb' because how could they compete with something that was already so simple ...
Re:Apple has new Mac app coming to make running local AI mod... by CompoundEyes on Wednesday November 11, 2026 @04:25AM (#50451286)
Don’t underestimate porn. There will be a moment when the average consumer can create personalized porn and erotica fully offline with a local LLM.
Re:Apple has new Mac app coming to make running local AI mod... by whycombilater on Wednesday November 11, 2026 @04:37AM (#50451392)
Well, they've captured the paedophile market then.

Personally, I find the whole idea of AI porn pretty depressing. Porn is very bad acting, or no acting, but at least the people are real.

Re:Apple has new Mac app coming to make running local AI mod... by hobo123 on Wednesday November 11, 2026 @12:15PM (#50455846)
Don't all models block that, and also not train on pr0n data?

First someone would need to invest and train a model on pr0n, and then they'd likely first want to recoup that money - perhaps by selling a subscription to pr0n addicts.

Re:Apple has new Mac app coming to make running local AI mod... by otabdeveloper4 on Wednesday November 11, 2026 @06:26AM (#50452146)
> running large LLMs on a MacBook Pro

Whatever local LLM device comes out of this, it certainly won't be a laptop.

(I envision a black box like a router you plug into a socket and let sit in a corner of some room.)

Re:Apple has new Mac app coming to make running local AI mod... by LUmBULtERA on Wednesday November 11, 2026 @06:34AM (#50452194)
The first time my family bought standalone RAM to upgrade our PC, it cost over $100 for 2 MB. Not GB, but MB. Consumers will get much larger stacks of RAM at some point, likely sooner than later.
Re:Apple has new Mac app coming to make running local AI mod... by I-M-S on Wednesday November 11, 2026 @08:33AM (#50453223)
As long as the models are censored (and under our system they have to be to reduce liability), there will be need for local LLMs.
Re:Apple has new Mac app coming to make running local AI mod... by krzyk on Wednesday November 11, 2026 @11:04AM (#50454983)
Local models are also frequently censored (try to search for some pirated content), depending on the provider.

You can get uncensored versions, but they are less usable (lobotomized).

Re:Apple has new Mac app coming to make running local AI mod... by spopejoy on Wednesday November 11, 2026 @04:27PM (#50458924)
If you select with care you can get fully-functional abliterated models. There are good abliterated Qwen 3.8 27B models and quantized versions thereof. Heretic Grimoire models are a good starting point.