News for hackers. Stuff that matters.
Re:Apple has new Mac app coming to make running local AI mod... by n_u on Tuesday November 10, 2026 @05:31PM (#50447234)
I think the question to me is whether Apple can ship affordable consumer devices with enough memory to run sufficiently useful models sufficiently fast.

Right now 128GB MacBook is the top of the line and you could do Qwen 3.8 Flash or similar.

There is a rumor that the M7 chip can use 1.5TB of memory which would imply Apple is aiming for more memory on devices.[1]

Would that imply the entry-level MacBook will have 128GB and top of the line models could run larger reasoning models? Then the question is price and if any of this will translate to iPhone for on-phone models.

With how expensive memory is, IDK if they can pull this off but I hope they do

[1] https://www.tomshardware.com/tech-industry/semiconductors/ap...

Re:Apple has new Mac app coming to make running local AI mod... by detourdog on Tuesday November 10, 2026 @05:47PM (#50447374)
Most likely Apple has been spending whatever they can to get in front of the memory market.
Re:Apple has new Mac app coming to make running local AI mod... by bigyabai on Tuesday November 10, 2026 @05:51PM (#50447421)
They definitely are, judging by their price increases.

Even so, DDR5 is so high-demand that it's likely that Apple can't outbid customers like Nvidia or OpenAI when they drive the margins they do.

Re:Apple has new Mac app coming to make running local AI mod... by detourdog on Tuesday November 10, 2026 @06:21PM (#50447733)
No but they can pay for new manufacturing to be built. 2-3 lead time should be enough to bankroll the effort. Apple has to much money to sit around hoping that memory situation resolves itself. They were caught flat footed by the RAM market.
Re:Apple has new Mac app coming to make running local AI mod... by kingleopold on Tuesday November 10, 2026 @07:39PM (#50448355)
they didnt realy caught flat, they knew their yoy growth rates and demands. NO AI company had that future demand so certain for all hardware they have. they could easily lock years of ram supply for next years extra demand but instead they went after few % margin there or whatever. they now enjoy it
Re:Apple has new Mac app coming to make running local AI mod... by detourdog on Tuesday November 10, 2026 @07:46PM (#50448422)
Are you suggesting that they knew there would be an extreme increase in RAM prices and did nothing because paying more would help their margin?
Re:Apple has new Mac app coming to make running local AI mod... by kingleopold on Tuesday November 10, 2026 @08:34PM (#50448782)
not exactly. I mean they saw increasing ram prices + they knew their demand. They did almost nothing for what months and year or more now? Lack of actions cost us a lot more than apple probably. They are happy to sell at few times more expensive ram, but here I'm thinking they could have great edge, they wasted it with all cash in hand.
Re:Apple has new Mac app coming to make running local AI mod... by Danox on Tuesday November 10, 2026 @08:19PM (#50448672)
In-house the market has changed, the conditions have changed, the price has changed the only way around this problem is to design and engineer around it in-house. The design and engineering capability isn’t the problem, money isn’t the problem. It’s whether or not the new CEO/Apple have the will to do what’s necessary. That’s pretty much the bottom line… they have done it before (Intel/Qualcomm), and they now have to do it again.
Re:Apple has new Mac app coming to make running local AI mod... by bigyabai on Tuesday November 10, 2026 @08:42PM (#50448823)
In-house, Apple has no fab. They have labs, but manufacturing memory would make them critically reliant on an expensive fab partner, probably driving them back to be an Intel customer again.
Re:Apple has new Mac app coming to make running local AI mod... by detourdog on Wednesday November 11, 2026 @08:14AM (#50453027)
I think they just have to fund a facility specifically to meet their RAM needs. It will take time but it's only a production issue.
Re:Apple has new Mac app coming to make running local AI mod... by bigyabai on Wednesday November 11, 2026 @02:21PM (#50457337)
From who?

SK hynix, Samsung and Micron are all eager to squeeze Apple for the market price of DDR5. They won't build extra fab capacity for them because Nvidia, AMD and OpenAI will outbid them for future capacity. Products like HBM are overbooked right now too, which means that building an extra DDR5 facility might just end up feeding the enterprise HBM market.

And CXMT has refused Apple's business entirely: https://appleinsider.com/articles/26/08/06/chinese-ram-suppl...

Re:Apple has new Mac app coming to make running local AI mod... by toufka on Tuesday November 10, 2026 @05:51PM (#50447414)
Even if it's 2030 - that's a mere 3 years from now - it will take at least that long for the greater economy to figure out how to use LLMs. And probably a memory boom/bust cycle in that time too.

If Apple, in 2030 has a compute product that a worker can BYO(X) to work that has 2TB RAM, with an encrypted personalized context that can float between agents, then they will be in a very interesting place.

Re:Apple has new Mac app coming to make running local AI mod... by majorchord on Tuesday November 10, 2026 @06:08PM (#50447612)
> 2030 - that's a mere 3 years from now

holy shit

Re:Apple has new Mac app coming to make running local AI mod... by fmbb on Wednesday November 11, 2026 @01:55AM (#50450444)
2038 is going to happen!
Re:Apple has new Mac app coming to make running local AI mod... by radicaldreamer on Tuesday November 10, 2026 @07:34PM (#50448312)
Can you give a citation for your 2030 being 3 years away claim
Re:Apple has new Mac app coming to make running local AI mod... by toufka on Tuesday November 10, 2026 @10:44PM (#50449534)
2030.01 - 2026.92 ~~ 3.09 years
Re:Apple has new Mac app coming to make running local AI mod... by asdff on Tuesday November 10, 2026 @07:06PM (#50448089)
Why is there a desire to have this stuff on the edge on the engineers lap instead of just building some arbitrarily scalable cluster for I'm guessing cheaper than apple's usual premium? Habitual practice from the engineers who would compile on the device getting hot in their lap? Lack of widespread hpc experience compared to running docker?
Re:Apple has new Mac app coming to make running local AI mod... by bix6 on Tuesday November 10, 2026 @07:33PM (#50448305)
People don’t want to send all their private company data to the model providers?
Re:Apple has new Mac app coming to make running local AI mod... by bronco21016 on Tuesday November 10, 2026 @07:37PM (#50448339)
Because why not? If you can get unlimited inference with roughly Opus 5.5 intelligence for $10k that easily beats current API pricing. Like not even a question.
Re:Apple has new Mac app coming to make running local AI mod... by codebje on Tuesday November 10, 2026 @07:43PM (#50448397)
Distrust in allowing an unreliable vendor to control the fate of your business?
Re:Apple has new Mac app coming to make running local AI mod... by aurmc on Tuesday November 10, 2026 @07:45PM (#50448413)
Many users would prefer to use a Sonnet-level (or better) LLM without sharing their data with others.

And with a device like this, you pay one single time to buy the product and then never have to think about paying for tokens ever again. For ordinary users that's silly, but for users or businesses chewing through lots of tokens, this means they can create their own turnkey replacement for "the cloud" where the only cost after purchasing the machine is the electricity to run it (which with these machines is very little). Mix that with the privacy benefits and suddenly it makes a lot of sense.

Re:Apple has new Mac app coming to make running local AI mod... by asdff on Tuesday November 10, 2026 @09:53PM (#50449253)
Seems everyone in this thread is assuming I am saying go to private third party compute. No. Build your own cluster on metal you own on property you own, and have your team use that and just some thin clients to write with. Your compute goes way further. Your cluster can be going 100% of the time with jobs queued up by your team. All that memory you buy for your team in macbooks is idle and unavailable when your employee closes the lid and tosses it into the bag into the car on the way home. It could be used 24/7. On hardware you own. For cheaper to build I'm sure than apple hardware tax. On easier OS to manage and no doubt deal with anything involving any sort of heavy compute work than OS X. Are we really going to waste resources with docker when we could be using a node completely? Come on.

Like I said, seems HPC is lost art. All four sub replies missed that in my original comment.

Re:Apple has new Mac app coming to make running local AI mod... by monegator on Wednesday November 11, 2026 @01:50AM (#50450403)
yes. People do not read.

I agree with you, and i would like to set up a server at work for local inference but we simply do not have the knowledge, it's much easier to get a couple of AI Max machines that are good enough for me and the boss which i convinced on the good points on running clankers locally and be done with it (though my plan is to use the AI MAX machines to figure out what the infrastructure and workflow will look like, and at some point ask for the investment)

Re:Apple has new Mac app coming to make running local AI mod... by rick1290 on Wednesday November 11, 2026 @02:02AM (#50450481)
this is neat. how has it been going with the ai max machines? also looking to do the same as id like to get ahead.
Re:Apple has new Mac app coming to make running local AI mod... by monegator on Wednesday November 11, 2026 @03:49AM (#50451090)
I don't know yet! The boxes have been sitting there for a while. It's been a crazy month
Re:Apple has new Mac app coming to make running local AI mod... by monegator on Saturday November 14, 2026 @10:59AM (#50498053)
ok, a colleague started playing with the AI MAX 395, qwen 3.8 flash next unsloth running at 40tk/s

damn, too bad that the laptops with the 470 are capped at 64GB

Re:Apple has new Mac app coming to make running local AI mod... by throwuxiytayq on Wednesday November 11, 2026 @02:30AM (#50450674)
> but we simply do not have the knowledge

How is this literally even possible in 2026? In a thread about LLMs, no less?

Re:Apple has new Mac app coming to make running local AI mod... by monegator on Wednesday November 11, 2026 @03:47AM (#50451073)
assimilating knowledge still take time, i do not take whatever LLMs regurgitate at face value.

Then there's testing the approaches and see whatever sticks best.

Re:Apple has new Mac app coming to make running local AI mod... by dansquizsoft on Wednesday November 11, 2026 @06:32AM (#50452178)
Yeah this is a wild take…
Re:Apple has new Mac app coming to make running local AI mod... by throwaway277432 on Wednesday November 11, 2026 @01:53AM (#50450423)
It's investors making these decisions. They would rather have predictable cloud spend than trying any experiments with high cap-ex. Has been this way since AWS is a thing.

Not saying they're right.

Re:Apple has new Mac app coming to make running local AI mod... by eddythompson80 on Wednesday November 11, 2026 @02:11AM (#50450544)
Your main argument is about better allocation for that RAM, which only makes sense in the conditions of a shortage. If RAM is plentiful, like it’s bound to be once the datacenters craze is over, that argument becomes “why does every apartment need a washer/dryer when we can have shared washers/dryers in a common area that are being used 100% of the time”. The answer is “because we can and it’s not that huge of a difference” plus you can have both. Like you can have a server cluster for large batch jobs, and personal ones for personal use.

For individuals though, it’s the same reason plenty of people pay for the 2tb or 4tb SSD for their laptops or desktops even though NAS has been a thing for 40 years. Maintaining a “server” of any sort is a completely separate endeavor for most. Just like a NAS is a no-brainer for many and non-starter for many more.

Re:Apple has new Mac app coming to make running local AI mod... by flaunf221 on Wednesday November 11, 2026 @04:04AM (#50451169)
RAM was dirt cheap before and yet until M3 Apple made laptops starting with 8 GB of RAM. Why do you think Apple will suddenly become generous later?

The problem with LLMs outside of server is that people typically have many devices. So you can run LLM on your laptop. You want to make a query from your phone. Start your laptop? You want to do something from your smart home? Start your laptop? What about your partner? Will they need to buy another top of the line laptop for themselves? Your kids?

Alternative to server is of course that everything will have over 100 GB of memory, eat battery like crazy, be dumber and slower than single server in your household.

4 TB ssd was like $300 until recently. Even if RAM prices were to go to previous values, I don't think AI capability will be any comparable. Besides you also need proper compute, unless you want your prefill to be snail slow.

Re:Apple has new Mac app coming to make running local AI mod... by eddythompson80 on Wednesday November 11, 2026 @04:30AM (#50451336)
It has nothing to do with generosity. Apple (and other laptop and PC makers) just have different segments of the market that they catered for. Plenty of people use laptops just to browse the web. They didn’t need a lot of RAM. Those who needed the RAM (usually branded as pro-users or “creators” or engineers) always had the option to get more RAM both from Apple and others at a premium. It’s just that ~32GB was the upper amount for almost any use case. Why would Apple put 256GB or 512GB in every laptop back when there was no use case for it?

Every scenario you described applies the same to a NAS. What if you need a file from your phone? Open your laptop? What if your partner needs a file? Open your laptop? The answer to all of them is either yes, or they have it on their laptop/phone too.

Apple (and other laptop makers) weren’t charging $300 for 4tb even before the shortage. They realized that not everyone needed that and they way overcharged for that but still less than today’s prices. People who needed it bought it even though it would have been a lot cheaper for them to build a NAS. A current-gen M5 is perfectly capable of doing decent tk/s given enough RAM. In 2 or 3 years it would be even more capable, it just needs RAM.

Plenty of people will use clou hosted models like they do with storage today. Plenty of people will build home servers for AI. Just like plenty of people have home NASs. But the number of people who just want a large SSD on their laptop make the previous group a rounding error and those people would rather have a beefy laptop or desktop with enough RAM in it. If anyone can solve the Phone<->Desktop communication seamlessly it’s Apple after all.

Unlike storage however, a lot of people are now aware of how much data collection tech and AI companies are doing and the idea that AI models are training on their personal photos and prompts is deeply unappealing to many. With just storage, what could Google or Apple do? Certainly they wouldn’t just print your photos and put them in an ad or on their website. But with AI models, it’s a different equation

Re:Apple has new Mac app coming to make running local AI mod... by flaunf221 on Wednesday November 11, 2026 @05:10AM (#50451643)
> Every scenario you described applies the same to a NAS.

No. Files are your property. Inference is a service.

There's also the fact that working with files over network is often ill-advised and borderline impossible for some workloads. Even when that NAS is connected over wire and not wireless. Meanwhile even if you're on so-so connection, LLMs work great.

Re:Apple has new Mac app coming to make running local AI mod... by eddythompson80 on Wednesday November 11, 2026 @05:16AM (#50451707)
And storage can’t be a service?
Re:Apple has new Mac app coming to make running local AI mod... by flaunf221 on Wednesday November 11, 2026 @06:02AM (#50451989)
A. Like I said - unless you invented magical communication channel that will give latency and speed and and reliability of local NVMe drive to your remote NAS, no, remote storage can't replace local storage in full.

NAS is mostly good for backups, torrenting linux isos and serving them with Plex or Jellyfin. You are not installing software on your NAS instead of your machine. Or doing video editing. Or playing demanding games. I have file server at home and I still have ~8 TB of storage in my desktop, of which at leat 3 TB I can't move out.

B. If I have 1 TB of my work files, my wife has 1 TB of her work files, that's 2 TB of total storage. If both us need LLM, it doesn't mean we need twice the LLM as one of us.

Re:Apple has new Mac app coming to make running local AI mod... by Gigachad on Wednesday November 11, 2026 @01:51AM (#50450411)
I don’t want it in my laptop, I want it in my mini server rack at home. I’m not running any of my personal data through an external service that is certainly collecting it as training data.
Re:Apple has new Mac app coming to make running local AI mod... by usrnm on Wednesday November 11, 2026 @02:44AM (#50450760)
I want it in neither my laptop nor my home server, which I don't even have, I want it in my phone or something even smaller. I understand that it's currently not possible, but this is the direction I want the technology to be moving into.
Re:Apple has new Mac app coming to make running local AI mod... by throwaway_new_1 on Wednesday November 11, 2026 @02:59AM (#50450828)
Highly likely it will happen. But at that point the phone will likely just be a slab of display and not much of an interface. Everything is done through an LLM and showed on the display. Not sure if touch screen will even be required at that point.
Re:Apple has new Mac app coming to make running local AI mod... by asdff on Wednesday November 11, 2026 @12:52PM (#50456260)
Great, because that's exactly what I suggested you do when I said "hpc" and not "anthropic subscription"
Re:Apple has new Mac app coming to make running local AI mod... by _ph_ on Wednesday November 11, 2026 @03:33AM (#50451000)
First of all, it seems to be possible to build a scalable cluster from TB5 Macs. They don't have to be on individual desks, they could be hosted in a data center.

But on the other side, equipping data centers was never Apples main business. Their approach to markets is to design products for the individuals. They also usually have very long time plans. Look at where the Apple Silicon today is and how long a path it took. What about the day, where at least a medium sized Mac becomes a great platform for running large models locally? Very easy to use, no setup, no privacy concerns. Also never worry about "tokens". You can then use AI as you use other local resources of the hardware you own today.

Re:Apple has new Mac app coming to make running local AI mod... by bradknowles on Tuesday November 10, 2026 @07:10PM (#50448122)
The Mac Studio hardware can do 512GB. That might be a hardware limit of the current architecture.

But the family shouldn’t be limited by that. We’re not going to see M6 Max hardware, because the M7 line is being fast-tracked and pulled forward. And I wouldn’t be at all surprised to see M7 capable of 1-2TB or more.

Re:Apple has new Mac app coming to make running local AI mod... by duskwuff on Tuesday November 10, 2026 @07:54PM (#50448466)
[delayed]
Re:Apple has new Mac app coming to make running local AI mod... by selectodude on Tuesday November 10, 2026 @07:55PM (#50448470)
M5 Ultra has 64 channels and the densest LPDDR5X chip is 16GB - so they could produce 1TB Macs but I doubt Micron or Samsung has any to sell.
Re:Apple has new Mac app coming to make running local AI mod... by jshier on Tuesday November 10, 2026 @08:06PM (#50448553)
And given the pricing of the 512GB model over $20,000, I image a 1TB version would be $50,000+.
Re:Apple has new Mac app coming to make running local AI mod... by bombcar on Tuesday November 10, 2026 @09:08PM (#50449000)
The last Intel Mac Pro could rock 1.5 TB.
Re:Apple has new Mac app coming to make running local AI mod... by Danox on Tuesday November 10, 2026 @08:13PM (#50448614)
The limit is strictly to cost of memory at this time. If you wanna get by that limit, you have to, well… design it yourself in house.
Re:Apple has new Mac app coming to make running local AI mod... by bigyabai on Tuesday November 10, 2026 @08:54PM (#50448908)
Do you really think that Micron, Samsung and SK hynix are working in a cartel to prevent DDR5 memory from being manufactured?

Spoiler alert: they're supply-constrained too. If they could make more money by shaking Apple down for binned memory chips, you can bet your bottom dollar that they would.

Re:Apple has new Mac app coming to make running local AI mod... by cromka on Wednesday November 11, 2026 @03:57AM (#50451131)
They were in a cartel once before already...
Re:Apple has new Mac app coming to make running local AI mod... by bigyabai on Wednesday November 11, 2026 @02:34PM (#50457468)
To constrain supply? Or to punish unreasonable demands?

Apple is just butthurt that they can't afford the street price for DDR5. Their computers are chopped liver.

Re:Apple has new Mac app coming to make running local AI mod... by protocolture on Tuesday November 10, 2026 @07:53PM (#50448460)
I dunno, I reckon they are targeting 64GB and will develop a smaller model thats built in by default that handles a lot of simple tasks quickly.

Probably sitting under a router, so that it can hand off bigger jobs to an Apple DC somewhere, probably with a certain number of credits based on your iCloud sub.

Re:Apple has new Mac app coming to make running local AI mod... by Danox on Tuesday November 10, 2026 @08:11PM (#50448597)
Apple’s position down the road. When the Chinese company CMXT takes a much bigger share of the memory market worldwide, and they will. Their dominance in memory will probably be pretty close to what BYD is today in the worldwide car industry.

I don’t think Apple can be in a position where all of the Chinese device-making companies can get memory at a significantly cheaper price from CMXT, and Apple is stuck with buying memory from the three hyenas of memory at a significantly higher price.

That’s not going to help Apple sell their devices at a competitive price worldwide over time against the Chinese computer makers (Lenovo, Asus, and Motorola) and make no mistake about it: their share of the market worldwide will get bigger because of this change in the memory market; their focus will be on the long term, while the lawyers/MBA/finance types in the West will have their heads stuck in the short term.

It’s the (Chinese companies’) opportunity, and they’re not going to let it pass; I wouldn’t. In addition, Apple is in competition with Nvidia, Microsoft, Intel, AMD, Qualcomm, Google, Meta, and indirectly with Anthropic and OpenAI (whose CEO, Sam Altman, recently declared that computer ram is wasted on low-level regular computer users), along with a whole legion of other 3D model makers on the procurement of memory.

The combination of all these elements going into the future means that if Apple wants to stay ahead, I believe Apple has no choice but to take memory in house, they have the design and engineering capability in-house, and they have the money because they didn’t burn it on AI models and data centers.

This scenario is no different than replacing Intel or Qualcomm; you can see the writing/destination and the ultimate train wreck up ahead if Apple doesn’t roll up its sleeves and get busy, the market has changed and again Apple has to change and adapt to the new conditions.

Re:Apple has new Mac app coming to make running local AI mod... by rogerrogerr on Wednesday November 11, 2026 @01:31AM (#50450320)
Why do you think the Chinese wouldn’t gladly sell Apple memory?
Re:Apple has new Mac app coming to make running local AI mod... by kalleboo on Wednesday November 11, 2026 @02:53AM (#50450792)
Aren't they on a sanctions list? Would the US government let them buy it?
Re:Apple has new Mac app coming to make running local AI mod... by michelb on Wednesday November 11, 2026 @03:07AM (#50450871)
Depends on whether there will be a sane government anytime in the future.
Re:Apple has new Mac app coming to make running local AI mod... by whycombilater on Wednesday November 11, 2026 @04:55AM (#50451549)
You're from hackernews, hackernews is terrible and you're a terrible commenter. You should be ashamed of yourself.

Why are you talking about memory? Nobody cares about memory. You know what people care about? People care about ballrooms, and you know what, the US has the best!

People who know ballrooms say the US is hot right now, hotter than anywhere else in the world, because we're building the best ballroom in the world. Can you imagine that? China is nowhere on ballrooms.

Re:Apple has new Mac app coming to make running local AI mod... by nxobject on Wednesday November 11, 2026 @05:22AM (#50451742)
/does the hands up and then pulls apart gesture, purses lips
Re:Apple has new Mac app coming to make running local AI mod... by esskay on Wednesday November 11, 2026 @06:35AM (#50452198)
If I recall Apple was planning on buying it pending permission from the US Government, and when the memory maker got wind their price sheet went up to match Samsung, making it pretty pointless as they had supply, it was price that was a problem for Apple.
Re:Apple has new Mac app coming to make running local AI mod... by mycall on Wednesday November 11, 2026 @08:51AM (#50453418)
It might be the opposite. Chinese DRAM isn't yet of same quality that Apple is used to.
Re:Apple has new Mac app coming to make running local AI mod... by nxobject on Wednesday November 11, 2026 @05:25AM (#50451758)
> The combination of all these elements going into the future means that if Apple wants to stay ahead, I believe Apple has no choice but to take memory in house, they have the design and engineering capability in-house, and they have the money because they didn’t burn it on AI models and data centers.

I wouldn't be surprised if that was happening already -- they plan five years ahead, after all, and they've been slowly taking other systems in-house (e.g. baseband/modem) already.

Re:Apple has new Mac app coming to make running local AI mod... by rogerkirkness on Tuesday November 10, 2026 @08:33PM (#50448768)
I'm on 128gb Mac and Laguna2.1 is able to do 800tps coding as good at Sonnet 4.5 or Opus 4. It's awesome.
Re:Apple has new Mac app coming to make running local AI mod... by Aurornis on Wednesday November 11, 2026 @01:27AM (#50450300)
> Would that imply the entry-level MacBook will have 128GB

Most people neither need nor want to run large LLMs locally.

The entry level MacBook Neo costs $599. Even if RAM prices revert to the pre-AI mean, the entry level models are not going to be that stacked with RAM.

Eventually we'll get to a doubling where entry level means 16GB of RAM, but most people won't be running anything more than simple models for light local work.

Have you ever tried running large LLMs on a MacBook Pro? It's hot, loud, and makes your battery level disappear at rates you didn't know were possible if you're not plugged in. It's a very niche hobby.

Re:Apple has new Mac app coming to make running local AI mod... by usrnm on Wednesday November 11, 2026 @02:35AM (#50450712)
> Most people neither need nor want to run large LLMs locally

I'm old enough to remember the time when most people neither needed nor wanted a phone with a large screen and no buttons

Re:Apple has new Mac app coming to make running local AI mod... by AdamN on Wednesday November 11, 2026 @03:16AM (#50450908)
I'm old enough to remember in NYC when people knew the number of their local car service and that tools like Uber were 'dumb' because how could they compete with something that was already so simple ...
Re:Apple has new Mac app coming to make running local AI mod... by CompoundEyes on Wednesday November 11, 2026 @04:25AM (#50451286)
Don’t underestimate porn. There will be a moment when the average consumer can create personalized porn and erotica fully offline with a local LLM.
Re:Apple has new Mac app coming to make running local AI mod... by whycombilater on Wednesday November 11, 2026 @04:37AM (#50451392)
Well, they've captured the paedophile market then.

Personally, I find the whole idea of AI porn pretty depressing. Porn is very bad acting, or no acting, but at least the people are real.

Re:Apple has new Mac app coming to make running local AI mod... by hobo123 on Wednesday November 11, 2026 @12:15PM (#50455846)
Don't all models block that, and also not train on pr0n data?

First someone would need to invest and train a model on pr0n, and then they'd likely first want to recoup that money - perhaps by selling a subscription to pr0n addicts.

Re:Apple has new Mac app coming to make running local AI mod... by otabdeveloper4 on Wednesday November 11, 2026 @06:26AM (#50452146)
> running large LLMs on a MacBook Pro

Whatever local LLM device comes out of this, it certainly won't be a laptop.

(I envision a black box like a router you plug into a socket and let sit in a corner of some room.)

Re:Apple has new Mac app coming to make running local AI mod... by LUmBULtERA on Wednesday November 11, 2026 @06:34AM (#50452194)
The first time my family bought standalone RAM to upgrade our PC, it cost over $100 for 2 MB. Not GB, but MB. Consumers will get much larger stacks of RAM at some point, likely sooner than later.
Re:Apple has new Mac app coming to make running local AI mod... by I-M-S on Wednesday November 11, 2026 @08:33AM (#50453223)
As long as the models are censored (and under our system they have to be to reduce liability), there will be need for local LLMs.
Re:Apple has new Mac app coming to make running local AI mod... by krzyk on Wednesday November 11, 2026 @11:04AM (#50454983)
Local models are also frequently censored (try to search for some pirated content), depending on the provider.

You can get uncensored versions, but they are less usable (lobotomized).

Re:Apple has new Mac app coming to make running local AI mod... by spopejoy on Wednesday November 11, 2026 @04:27PM (#50458924)
If you select with care you can get fully-functional abliterated models. There are good abliterated Qwen 3.8 27B models and quantized versions thereof. Heretic Grimoire models are a good starting point.
Re:Apple has new Mac app coming to make running local AI mod... by flanz_10 on Wednesday November 11, 2026 @01:28AM (#50450305)
> whether Apple can ship affordable consumer devices with enough memory to run sufficiently useful models sufficiently fast.

i suspect that they will at least do offloading for casual usage as well. if they can ship 24GB in a homeview or appletv style product, it's game over.

Re:Apple has new Mac app coming to make running local AI mod... by whywhywhywhy on Wednesday November 11, 2026 @09:12AM (#50453657)
> Would that imply the entry-level MacBook will have 128GB

why would a company who locks iPad Pro entry level literally out of ram that exists on its own chips.

I get their high end 10k-20k laptops will be able to reach these specs and gatekept behind also upgrading the cpu to the ultra but no way will it be an option in entry level.