News for hackers. Stuff that matters.
Re:Apple has new Mac app coming to make running local AI mod... by pen2l on Tuesday November 10, 2026 @05:18PM (#50447085)
Apple, to me, is the winner in the end of this AI chapter.

Distillation works: we can get models leaner, have better performance with lesser and lesser parameters, more efficient. Apple gets this and we'll see the result with M7 Max/ultra chips and I reckon this will be one of the titular apps when M7 line of chips are introduced.

I guess it explains the haste Anthropic and OpenAI are in to IPO, cash out and leave the the retail investor holding the bag.

Re:Apple has new Mac app coming to make running local AI mod... by bigyabai on Tuesday November 10, 2026 @05:20PM (#50447109)
Man, if all that makes Apple a "winner" then I'm dying to hear your assessment of Nvidia.

Factoring in the increased cost of memory, Apple's threatened service revenue and the stagnation of ecosystem products like the Mac and iPad, I think they have a really challenging future to navigate. The whole "sell people a B2C ecosystem" business model is more threatened than ever.

Re:Apple has new Mac app coming to make running local AI mod... by pen2l on Tuesday November 10, 2026 @05:22PM (#50447129)
The contrast I'm drawing is running these models locally vs on the cloud and how that would be a selling point well received.
Re:Apple has new Mac app coming to make running local AI mod... by bigyabai on Tuesday November 10, 2026 @05:23PM (#50447139)
I don't think that's materially different from what you can do with Nvidia and AMD GPUs, besides the fact that you're limited to Thunderbolt interconnect.
Re:Apple has new Mac app coming to make running local AI mod... by jmuguy on Tuesday November 10, 2026 @06:55PM (#50448006)
And that we don't want to carry a giant, hot, eGPU enclosure around with us.
Re:Apple has new Mac app coming to make running local AI mod... by Affric on Tuesday November 10, 2026 @07:10PM (#50448119)
Yeah, what apple have frequently got right is the actual product/UX.

Capability is one thing but a focus on the actual product, as an teleological destination that is built rather than something cobbled together as a solution to a problem about how to sell what you have generally has taken them the right way.

Re:Apple has new Mac app coming to make running local AI mod... by bigyabai on Tuesday November 10, 2026 @08:32PM (#50448760)
For all of those accolades, the Mac is still a minority player in every computer market. They're especially a non-entity in on-prem enterprise buildouts and datacenter construction, which is where the money is going right now.

It's nice to have these types of niches when they make you money. But the Mac isn't profitable like the iPhone is, and probably makes less money than the iPad does if you count aftermarket service sales. The further Apple drifts from their roots as a computer manufacturer, the more the Mac starts to look like a liability to them.

Apple's Last Stand is their prosumer segment, and once that's gone I don't think their vertical integration playbook gets them anywhere further. Their bottom line is dependent on finding new ways to make B2C profitable, which has resulted in subscription services like AppleTV/Apple Music/iCloud so far.

Re:Apple has new Mac app coming to make running local AI mod... by DrScientist on Wednesday November 11, 2026 @06:46AM (#50452281)
It has about 10% of the global laptop market - and that's growing - making it the 4th largest single vendor, and it has about 35-40% of the global tablet market.

That looks pretty healthy to me.

Note that because most enterprise software is now web based ( ie moved to the data centre as you have pointed out ) - a lot of the corporate Windows only lockin has gone - so I'm seeing a steady rise in Macs in business.

What's not healthy is the desktop market ( apple laptops outsell desktops like 10:1 ) - but that's whiles that's more marked in the Apple space, it's largely an overall market trend. ( Overall desktops are about 20% of total shipments ).

So Apple will only be in trouble in this space if the laptop ceases to become wanted - and that's all about the interface - some apps are better with keyboard and mouse/trackpad and a bigger screen. If all that goes away and we just talk to our computers then I'd argue that Apple are better placed than Lenovo to weather that one.

Re:Apple has new Mac app coming to make running local AI mod... by bigyabai on Wednesday November 11, 2026 @02:32PM (#50457442)
Apple has had "about 10% of the global laptop market" since 2013. If there's some powerful growth driver, I'm not seeing it.

The proliferation of web-based enterprise software mostly stands to Windows and ChromeOS' advantage. macOS is the platform that has relied on "native" and "ecosystem" efforts that are becoming increasingly unpopular among consumers and industry pundits that don't like paying per-seat for software services. The Mac Pro used for render farms, on-prem hosting and cluster computing was depreciated completely, driving some of Apple's highest-margin customers over to Linux and Windows servers. Apple has absolutely began their Mac pivot to prosumer/B2C vending, and it's resulted in advertisements and SaaS slop invading macOS.

Lenovo will keep selling laptops because that's their product equivalent to the iPhone. Apple's equivalent to the iPhone is... well, the iPhone. If they see an opportunity to force Mac users into an iPad-esque experience, they'll take it in a heartbeat and play coy asking "what's a computer?" like the iPad advertisements. The Mac not an important product for Apple these days, the App Store is.

Re:Apple has new Mac app coming to make running local AI mod... by DrScientist on Thursday November 12, 2026 @05:14AM (#50465258)
I see you've moved the goals posts from Apple is circling the drain to 'not a powerful growth driver'.

Totally agree that Mac servers ( they went years ago ) and Mac desktops ( and desktops in general ) are on decline.

I just think you are basing your opinion on the past. Sure in the past, when Apple hardware was worse overall than the Wintel offering, Apple heavily relied on the Mac specific software, and your right that's less important now more than ever.

But the point here is right now, and for the last few years, Apple hardware is significantly better! And because of this in turns your argument on it's head.

I think we both agree that the landscape in terms of mix of devices may change in the future - I just think Apple is following that market, not 'forcing' Mac users into an iPad-esque experience.

And right now I think the laptop market is still pretty healthy - I can't see Apple moving away from it unless sales drop, and as I said sales are rising.

Re:Apple has new Mac app coming to make running local AI mod... by bigyabai on Thursday November 12, 2026 @11:50PM (#50478491)
I didn't say Apple is circling the drain. I'm saying that their hardware advantage has driven close to zero growth when compared with AMD, Nvidia or even Intel. That investment is only worth it if they can sell more services, so from Apple's POV it's all hunky-dory to lose the datacenter and professional customers. From the user POV, there's not much reason to reward Apple over Microsoft if they both load up their OSes with ads and crapware. Apple has the advantage, but they're losing to the underdogs simply because of their arbitrary business choices. It's a profoundly dumb strategy to invest your hardware advantage into selling subscriptions. That's the issue.

What I meant by "Apple's Last Stand" was referring to the Mac. Their destiny is to become "the iPhone company", and their inability to support the Mac as a competitive product has basically guaranteed that fate. The landscape of computing already changed, and when Apple was confronted with the opportunity to invest in GPGPU products, Vulkan or PCIe hardware support, they forced those customers to pound sand. That is not an optimistic outlook for their future ambitions, at least from where I'm standing. The "my way or the highway" philosophy is hemorrhaging market share.

Re:Apple has new Mac app coming to make running local AI mod... by DrScientist on Friday November 13, 2026 @10:04AM (#50484598)
> The "my way or the highway" philosophy is hemorrhaging market share.

The data says the opposite.

In the only non-phone markets that matter - laptops and tablets - Apple is doing very well - and as I said, in the laptop market it is growing market share.

It's fine not to like Apple, Apple products or the choices they have made - but you need to ground your arguments on the facts. Yep you might not be their target customer - and they may have lost you - but overall their laptop market share is growing.

Re:Apple has new Mac app coming to make running local AI mod... by Danox on Tuesday November 10, 2026 @08:30PM (#50448739)
The design and engineering of memory is not more difficult than replacing Intel and Qualcomm, Apple certainly has the money, and they certainly have the engineering talent within the Apple Silicon design group. It took 13 years to replace Intel and six years to replace Qualcomm who has already warned their investors that they anticipate losing revenue in the near future. The question is whether or not they have the will to do so, money and engineering ability isn’t the problem, it is simply a matter of will. With CMXT coming online bigger and stronger.

I don’t think there will be a choice long-term for Apple the conditions of the market have changed, and you have to change with it or get left by the wayside. They have shown that they will adapt and they certainly haven’t wasted money like their tech competition over the years.

Re:Apple has new Mac app coming to make running local AI mod... by bigyabai on Tuesday November 10, 2026 @08:46PM (#50448863)
Difference being, Apple had experience designing processors and radio chips before ditching Intel and Qualcomm. The transition felt "magical" because it was a generally low-effort layer on top of a muscle that Apple had gradually built over time. Their design approach is not compatible with scaled manufacturing; Apple does not have experience manufacturing DRAM at all. They don't have their own fabs, nor could they bid on fab space when AI companies outspend them 10:1.

Apple would make more money investing in a CUDA-style architecture than they would by becoming a subsistance manufacturer for the pitiful margins of the iPhone, iPad and Mac. They are a moneymaking company, a fact often lost on the masses that

Re:Apple has new Mac app coming to make running local AI mod... by mietek on Wednesday November 11, 2026 @06:25AM (#50452141)
Indeed, why doesn't Apple have their own fabs yet?
Re:Apple has new Mac app coming to make running local AI mod... by bigyabai on Wednesday November 11, 2026 @02:22PM (#50457345)
glances at Intel

You tell me.

Re:Apple has new Mac app coming to make running local AI mod... by n_u on Tuesday November 10, 2026 @05:31PM (#50447234)
I think the question to me is whether Apple can ship affordable consumer devices with enough memory to run sufficiently useful models sufficiently fast.

Right now 128GB MacBook is the top of the line and you could do Qwen 3.8 Flash or similar.

There is a rumor that the M7 chip can use 1.5TB of memory which would imply Apple is aiming for more memory on devices.[1]

Would that imply the entry-level MacBook will have 128GB and top of the line models could run larger reasoning models? Then the question is price and if any of this will translate to iPhone for on-phone models.

With how expensive memory is, IDK if they can pull this off but I hope they do

[1] https://www.tomshardware.com/tech-industry/semiconductors/ap...

Re:Apple has new Mac app coming to make running local AI mod... by detourdog on Tuesday November 10, 2026 @05:47PM (#50447374)
Most likely Apple has been spending whatever they can to get in front of the memory market.
Re:Apple has new Mac app coming to make running local AI mod... by bigyabai on Tuesday November 10, 2026 @05:51PM (#50447421)
They definitely are, judging by their price increases.

Even so, DDR5 is so high-demand that it's likely that Apple can't outbid customers like Nvidia or OpenAI when they drive the margins they do.

Re:Apple has new Mac app coming to make running local AI mod... by detourdog on Tuesday November 10, 2026 @06:21PM (#50447733)
No but they can pay for new manufacturing to be built. 2-3 lead time should be enough to bankroll the effort. Apple has to much money to sit around hoping that memory situation resolves itself. They were caught flat footed by the RAM market.
Re:Apple has new Mac app coming to make running local AI mod... by kingleopold on Tuesday November 10, 2026 @07:39PM (#50448355)
they didnt realy caught flat, they knew their yoy growth rates and demands. NO AI company had that future demand so certain for all hardware they have. they could easily lock years of ram supply for next years extra demand but instead they went after few % margin there or whatever. they now enjoy it
Re:Apple has new Mac app coming to make running local AI mod... by detourdog on Tuesday November 10, 2026 @07:46PM (#50448422)
Are you suggesting that they knew there would be an extreme increase in RAM prices and did nothing because paying more would help their margin?
Re:Apple has new Mac app coming to make running local AI mod... by kingleopold on Tuesday November 10, 2026 @08:34PM (#50448782)
not exactly. I mean they saw increasing ram prices + they knew their demand. They did almost nothing for what months and year or more now? Lack of actions cost us a lot more than apple probably. They are happy to sell at few times more expensive ram, but here I'm thinking they could have great edge, they wasted it with all cash in hand.
Re:Apple has new Mac app coming to make running local AI mod... by Danox on Tuesday November 10, 2026 @08:19PM (#50448672)
In-house the market has changed, the conditions have changed, the price has changed the only way around this problem is to design and engineer around it in-house. The design and engineering capability isn’t the problem, money isn’t the problem. It’s whether or not the new CEO/Apple have the will to do what’s necessary. That’s pretty much the bottom line… they have done it before (Intel/Qualcomm), and they now have to do it again.
Re:Apple has new Mac app coming to make running local AI mod... by bigyabai on Tuesday November 10, 2026 @08:42PM (#50448823)
In-house, Apple has no fab. They have labs, but manufacturing memory would make them critically reliant on an expensive fab partner, probably driving them back to be an Intel customer again.
Re:Apple has new Mac app coming to make running local AI mod... by detourdog on Wednesday November 11, 2026 @08:14AM (#50453027)
I think they just have to fund a facility specifically to meet their RAM needs. It will take time but it's only a production issue.
Re:Apple has new Mac app coming to make running local AI mod... by bigyabai on Wednesday November 11, 2026 @02:21PM (#50457337)
From who?

SK hynix, Samsung and Micron are all eager to squeeze Apple for the market price of DDR5. They won't build extra fab capacity for them because Nvidia, AMD and OpenAI will outbid them for future capacity. Products like HBM are overbooked right now too, which means that building an extra DDR5 facility might just end up feeding the enterprise HBM market.

And CXMT has refused Apple's business entirely: https://appleinsider.com/articles/26/08/06/chinese-ram-suppl...

Re:Apple has new Mac app coming to make running local AI mod... by toufka on Tuesday November 10, 2026 @05:51PM (#50447414)
Even if it's 2030 - that's a mere 3 years from now - it will take at least that long for the greater economy to figure out how to use LLMs. And probably a memory boom/bust cycle in that time too.

If Apple, in 2030 has a compute product that a worker can BYO(X) to work that has 2TB RAM, with an encrypted personalized context that can float between agents, then they will be in a very interesting place.

Re:Apple has new Mac app coming to make running local AI mod... by majorchord on Tuesday November 10, 2026 @06:08PM (#50447612)
> 2030 - that's a mere 3 years from now

holy shit

Re:Apple has new Mac app coming to make running local AI mod... by fmbb on Wednesday November 11, 2026 @01:55AM (#50450444)
2038 is going to happen!
Re:Apple has new Mac app coming to make running local AI mod... by radicaldreamer on Tuesday November 10, 2026 @07:34PM (#50448312)
Can you give a citation for your 2030 being 3 years away claim
Re:Apple has new Mac app coming to make running local AI mod... by toufka on Tuesday November 10, 2026 @10:44PM (#50449534)
2030.01 - 2026.92 ~~ 3.09 years
Re:Apple has new Mac app coming to make running local AI mod... by asdff on Tuesday November 10, 2026 @07:06PM (#50448089)
Why is there a desire to have this stuff on the edge on the engineers lap instead of just building some arbitrarily scalable cluster for I'm guessing cheaper than apple's usual premium? Habitual practice from the engineers who would compile on the device getting hot in their lap? Lack of widespread hpc experience compared to running docker?
Re:Apple has new Mac app coming to make running local AI mod... by bix6 on Tuesday November 10, 2026 @07:33PM (#50448305)
People don’t want to send all their private company data to the model providers?
Re:Apple has new Mac app coming to make running local AI mod... by bronco21016 on Tuesday November 10, 2026 @07:37PM (#50448339)
Because why not? If you can get unlimited inference with roughly Opus 5.5 intelligence for $10k that easily beats current API pricing. Like not even a question.
Re:Apple has new Mac app coming to make running local AI mod... by codebje on Tuesday November 10, 2026 @07:43PM (#50448397)
Distrust in allowing an unreliable vendor to control the fate of your business?
Re:Apple has new Mac app coming to make running local AI mod... by aurmc on Tuesday November 10, 2026 @07:45PM (#50448413)
Many users would prefer to use a Sonnet-level (or better) LLM without sharing their data with others.

And with a device like this, you pay one single time to buy the product and then never have to think about paying for tokens ever again. For ordinary users that's silly, but for users or businesses chewing through lots of tokens, this means they can create their own turnkey replacement for "the cloud" where the only cost after purchasing the machine is the electricity to run it (which with these machines is very little). Mix that with the privacy benefits and suddenly it makes a lot of sense.

Re:Apple has new Mac app coming to make running local AI mod... by asdff on Tuesday November 10, 2026 @09:53PM (#50449253)
Seems everyone in this thread is assuming I am saying go to private third party compute. No. Build your own cluster on metal you own on property you own, and have your team use that and just some thin clients to write with. Your compute goes way further. Your cluster can be going 100% of the time with jobs queued up by your team. All that memory you buy for your team in macbooks is idle and unavailable when your employee closes the lid and tosses it into the bag into the car on the way home. It could be used 24/7. On hardware you own. For cheaper to build I'm sure than apple hardware tax. On easier OS to manage and no doubt deal with anything involving any sort of heavy compute work than OS X. Are we really going to waste resources with docker when we could be using a node completely? Come on.

Like I said, seems HPC is lost art. All four sub replies missed that in my original comment.

Re:Apple has new Mac app coming to make running local AI mod... by monegator on Wednesday November 11, 2026 @01:50AM (#50450403)
yes. People do not read.

I agree with you, and i would like to set up a server at work for local inference but we simply do not have the knowledge, it's much easier to get a couple of AI Max machines that are good enough for me and the boss which i convinced on the good points on running clankers locally and be done with it (though my plan is to use the AI MAX machines to figure out what the infrastructure and workflow will look like, and at some point ask for the investment)

Re:Apple has new Mac app coming to make running local AI mod... by rick1290 on Wednesday November 11, 2026 @02:02AM (#50450481)
this is neat. how has it been going with the ai max machines? also looking to do the same as id like to get ahead.
Re:Apple has new Mac app coming to make running local AI mod... by monegator on Wednesday November 11, 2026 @03:49AM (#50451090)
I don't know yet! The boxes have been sitting there for a while. It's been a crazy month
Re:Apple has new Mac app coming to make running local AI mod... by monegator on Saturday November 14, 2026 @10:59AM (#50498053)
ok, a colleague started playing with the AI MAX 395, qwen 3.8 flash next unsloth running at 40tk/s

damn, too bad that the laptops with the 470 are capped at 64GB

Re:Apple has new Mac app coming to make running local AI mod... by throwuxiytayq on Wednesday November 11, 2026 @02:30AM (#50450674)
> but we simply do not have the knowledge

How is this literally even possible in 2026? In a thread about LLMs, no less?

Re:Apple has new Mac app coming to make running local AI mod... by monegator on Wednesday November 11, 2026 @03:47AM (#50451073)
assimilating knowledge still take time, i do not take whatever LLMs regurgitate at face value.

Then there's testing the approaches and see whatever sticks best.

Re:Apple has new Mac app coming to make running local AI mod... by dansquizsoft on Wednesday November 11, 2026 @06:32AM (#50452178)
Yeah this is a wild take…
Re:Apple has new Mac app coming to make running local AI mod... by throwaway277432 on Wednesday November 11, 2026 @01:53AM (#50450423)
It's investors making these decisions. They would rather have predictable cloud spend than trying any experiments with high cap-ex. Has been this way since AWS is a thing.

Not saying they're right.

Re:Apple has new Mac app coming to make running local AI mod... by eddythompson80 on Wednesday November 11, 2026 @02:11AM (#50450544)
Your main argument is about better allocation for that RAM, which only makes sense in the conditions of a shortage. If RAM is plentiful, like it’s bound to be once the datacenters craze is over, that argument becomes “why does every apartment need a washer/dryer when we can have shared washers/dryers in a common area that are being used 100% of the time”. The answer is “because we can and it’s not that huge of a difference” plus you can have both. Like you can have a server cluster for large batch jobs, and personal ones for personal use.

For individuals though, it’s the same reason plenty of people pay for the 2tb or 4tb SSD for their laptops or desktops even though NAS has been a thing for 40 years. Maintaining a “server” of any sort is a completely separate endeavor for most. Just like a NAS is a no-brainer for many and non-starter for many more.

Re:Apple has new Mac app coming to make running local AI mod... by flaunf221 on Wednesday November 11, 2026 @04:04AM (#50451169)
RAM was dirt cheap before and yet until M3 Apple made laptops starting with 8 GB of RAM. Why do you think Apple will suddenly become generous later?

The problem with LLMs outside of server is that people typically have many devices. So you can run LLM on your laptop. You want to make a query from your phone. Start your laptop? You want to do something from your smart home? Start your laptop? What about your partner? Will they need to buy another top of the line laptop for themselves? Your kids?

Alternative to server is of course that everything will have over 100 GB of memory, eat battery like crazy, be dumber and slower than single server in your household.

4 TB ssd was like $300 until recently. Even if RAM prices were to go to previous values, I don't think AI capability will be any comparable. Besides you also need proper compute, unless you want your prefill to be snail slow.

Re:Apple has new Mac app coming to make running local AI mod... by eddythompson80 on Wednesday November 11, 2026 @04:30AM (#50451336)
It has nothing to do with generosity. Apple (and other laptop and PC makers) just have different segments of the market that they catered for. Plenty of people use laptops just to browse the web. They didn’t need a lot of RAM. Those who needed the RAM (usually branded as pro-users or “creators” or engineers) always had the option to get more RAM both from Apple and others at a premium. It’s just that ~32GB was the upper amount for almost any use case. Why would Apple put 256GB or 512GB in every laptop back when there was no use case for it?

Every scenario you described applies the same to a NAS. What if you need a file from your phone? Open your laptop? What if your partner needs a file? Open your laptop? The answer to all of them is either yes, or they have it on their laptop/phone too.

Apple (and other laptop makers) weren’t charging $300 for 4tb even before the shortage. They realized that not everyone needed that and they way overcharged for that but still less than today’s prices. People who needed it bought it even though it would have been a lot cheaper for them to build a NAS. A current-gen M5 is perfectly capable of doing decent tk/s given enough RAM. In 2 or 3 years it would be even more capable, it just needs RAM.

Plenty of people will use clou hosted models like they do with storage today. Plenty of people will build home servers for AI. Just like plenty of people have home NASs. But the number of people who just want a large SSD on their laptop make the previous group a rounding error and those people would rather have a beefy laptop or desktop with enough RAM in it. If anyone can solve the Phone<->Desktop communication seamlessly it’s Apple after all.

Unlike storage however, a lot of people are now aware of how much data collection tech and AI companies are doing and the idea that AI models are training on their personal photos and prompts is deeply unappealing to many. With just storage, what could Google or Apple do? Certainly they wouldn’t just print your photos and put them in an ad or on their website. But with AI models, it’s a different equation

Re:Apple has new Mac app coming to make running local AI mod... by flaunf221 on Wednesday November 11, 2026 @05:10AM (#50451643)
> Every scenario you described applies the same to a NAS.

No. Files are your property. Inference is a service.

There's also the fact that working with files over network is often ill-advised and borderline impossible for some workloads. Even when that NAS is connected over wire and not wireless. Meanwhile even if you're on so-so connection, LLMs work great.

Re:Apple has new Mac app coming to make running local AI mod... by eddythompson80 on Wednesday November 11, 2026 @05:16AM (#50451707)
And storage can’t be a service?
Re:Apple has new Mac app coming to make running local AI mod... by flaunf221 on Wednesday November 11, 2026 @06:02AM (#50451989)
A. Like I said - unless you invented magical communication channel that will give latency and speed and and reliability of local NVMe drive to your remote NAS, no, remote storage can't replace local storage in full.

NAS is mostly good for backups, torrenting linux isos and serving them with Plex or Jellyfin. You are not installing software on your NAS instead of your machine. Or doing video editing. Or playing demanding games. I have file server at home and I still have ~8 TB of storage in my desktop, of which at leat 3 TB I can't move out.

B. If I have 1 TB of my work files, my wife has 1 TB of her work files, that's 2 TB of total storage. If both us need LLM, it doesn't mean we need twice the LLM as one of us.

Re:Apple has new Mac app coming to make running local AI mod... by Gigachad on Wednesday November 11, 2026 @01:51AM (#50450411)
I don’t want it in my laptop, I want it in my mini server rack at home. I’m not running any of my personal data through an external service that is certainly collecting it as training data.
Re:Apple has new Mac app coming to make running local AI mod... by usrnm on Wednesday November 11, 2026 @02:44AM (#50450760)
I want it in neither my laptop nor my home server, which I don't even have, I want it in my phone or something even smaller. I understand that it's currently not possible, but this is the direction I want the technology to be moving into.
Re:Apple has new Mac app coming to make running local AI mod... by throwaway_new_1 on Wednesday November 11, 2026 @02:59AM (#50450828)
Highly likely it will happen. But at that point the phone will likely just be a slab of display and not much of an interface. Everything is done through an LLM and showed on the display. Not sure if touch screen will even be required at that point.
Re:Apple has new Mac app coming to make running local AI mod... by asdff on Wednesday November 11, 2026 @12:52PM (#50456260)
Great, because that's exactly what I suggested you do when I said "hpc" and not "anthropic subscription"
Re:Apple has new Mac app coming to make running local AI mod... by _ph_ on Wednesday November 11, 2026 @03:33AM (#50451000)
First of all, it seems to be possible to build a scalable cluster from TB5 Macs. They don't have to be on individual desks, they could be hosted in a data center.

But on the other side, equipping data centers was never Apples main business. Their approach to markets is to design products for the individuals. They also usually have very long time plans. Look at where the Apple Silicon today is and how long a path it took. What about the day, where at least a medium sized Mac becomes a great platform for running large models locally? Very easy to use, no setup, no privacy concerns. Also never worry about "tokens". You can then use AI as you use other local resources of the hardware you own today.

Re:Apple has new Mac app coming to make running local AI mod... by bradknowles on Tuesday November 10, 2026 @07:10PM (#50448122)
The Mac Studio hardware can do 512GB. That might be a hardware limit of the current architecture.

But the family shouldn’t be limited by that. We’re not going to see M6 Max hardware, because the M7 line is being fast-tracked and pulled forward. And I wouldn’t be at all surprised to see M7 capable of 1-2TB or more.

Re:Apple has new Mac app coming to make running local AI mod... by duskwuff on Tuesday November 10, 2026 @07:54PM (#50448466)
[delayed]
Re:Apple has new Mac app coming to make running local AI mod... by selectodude on Tuesday November 10, 2026 @07:55PM (#50448470)
M5 Ultra has 64 channels and the densest LPDDR5X chip is 16GB - so they could produce 1TB Macs but I doubt Micron or Samsung has any to sell.
Re:Apple has new Mac app coming to make running local AI mod... by jshier on Tuesday November 10, 2026 @08:06PM (#50448553)
And given the pricing of the 512GB model over $20,000, I image a 1TB version would be $50,000+.
Re:Apple has new Mac app coming to make running local AI mod... by bombcar on Tuesday November 10, 2026 @09:08PM (#50449000)
The last Intel Mac Pro could rock 1.5 TB.
Re:Apple has new Mac app coming to make running local AI mod... by Danox on Tuesday November 10, 2026 @08:13PM (#50448614)
The limit is strictly to cost of memory at this time. If you wanna get by that limit, you have to, well… design it yourself in house.
Re:Apple has new Mac app coming to make running local AI mod... by bigyabai on Tuesday November 10, 2026 @08:54PM (#50448908)
Do you really think that Micron, Samsung and SK hynix are working in a cartel to prevent DDR5 memory from being manufactured?

Spoiler alert: they're supply-constrained too. If they could make more money by shaking Apple down for binned memory chips, you can bet your bottom dollar that they would.

Re:Apple has new Mac app coming to make running local AI mod... by cromka on Wednesday November 11, 2026 @03:57AM (#50451131)
They were in a cartel once before already...
Re:Apple has new Mac app coming to make running local AI mod... by bigyabai on Wednesday November 11, 2026 @02:34PM (#50457468)
To constrain supply? Or to punish unreasonable demands?

Apple is just butthurt that they can't afford the street price for DDR5. Their computers are chopped liver.

Re:Apple has new Mac app coming to make running local AI mod... by protocolture on Tuesday November 10, 2026 @07:53PM (#50448460)
I dunno, I reckon they are targeting 64GB and will develop a smaller model thats built in by default that handles a lot of simple tasks quickly.

Probably sitting under a router, so that it can hand off bigger jobs to an Apple DC somewhere, probably with a certain number of credits based on your iCloud sub.

Re:Apple has new Mac app coming to make running local AI mod... by Danox on Tuesday November 10, 2026 @08:11PM (#50448597)
Apple’s position down the road. When the Chinese company CMXT takes a much bigger share of the memory market worldwide, and they will. Their dominance in memory will probably be pretty close to what BYD is today in the worldwide car industry.

I don’t think Apple can be in a position where all of the Chinese device-making companies can get memory at a significantly cheaper price from CMXT, and Apple is stuck with buying memory from the three hyenas of memory at a significantly higher price.

That’s not going to help Apple sell their devices at a competitive price worldwide over time against the Chinese computer makers (Lenovo, Asus, and Motorola) and make no mistake about it: their share of the market worldwide will get bigger because of this change in the memory market; their focus will be on the long term, while the lawyers/MBA/finance types in the West will have their heads stuck in the short term.

It’s the (Chinese companies’) opportunity, and they’re not going to let it pass; I wouldn’t. In addition, Apple is in competition with Nvidia, Microsoft, Intel, AMD, Qualcomm, Google, Meta, and indirectly with Anthropic and OpenAI (whose CEO, Sam Altman, recently declared that computer ram is wasted on low-level regular computer users), along with a whole legion of other 3D model makers on the procurement of memory.

The combination of all these elements going into the future means that if Apple wants to stay ahead, I believe Apple has no choice but to take memory in house, they have the design and engineering capability in-house, and they have the money because they didn’t burn it on AI models and data centers.

This scenario is no different than replacing Intel or Qualcomm; you can see the writing/destination and the ultimate train wreck up ahead if Apple doesn’t roll up its sleeves and get busy, the market has changed and again Apple has to change and adapt to the new conditions.

Re:Apple has new Mac app coming to make running local AI mod... by rogerrogerr on Wednesday November 11, 2026 @01:31AM (#50450320)
Why do you think the Chinese wouldn’t gladly sell Apple memory?
Re:Apple has new Mac app coming to make running local AI mod... by kalleboo on Wednesday November 11, 2026 @02:53AM (#50450792)
Aren't they on a sanctions list? Would the US government let them buy it?
Re:Apple has new Mac app coming to make running local AI mod... by michelb on Wednesday November 11, 2026 @03:07AM (#50450871)
Depends on whether there will be a sane government anytime in the future.
Re:Apple has new Mac app coming to make running local AI mod... by whycombilater on Wednesday November 11, 2026 @04:55AM (#50451549)
You're from hackernews, hackernews is terrible and you're a terrible commenter. You should be ashamed of yourself.

Why are you talking about memory? Nobody cares about memory. You know what people care about? People care about ballrooms, and you know what, the US has the best!

People who know ballrooms say the US is hot right now, hotter than anywhere else in the world, because we're building the best ballroom in the world. Can you imagine that? China is nowhere on ballrooms.

Re:Apple has new Mac app coming to make running local AI mod... by nxobject on Wednesday November 11, 2026 @05:22AM (#50451742)
/does the hands up and then pulls apart gesture, purses lips
Re:Apple has new Mac app coming to make running local AI mod... by esskay on Wednesday November 11, 2026 @06:35AM (#50452198)
If I recall Apple was planning on buying it pending permission from the US Government, and when the memory maker got wind their price sheet went up to match Samsung, making it pretty pointless as they had supply, it was price that was a problem for Apple.
Re:Apple has new Mac app coming to make running local AI mod... by mycall on Wednesday November 11, 2026 @08:51AM (#50453418)
It might be the opposite. Chinese DRAM isn't yet of same quality that Apple is used to.
Re:Apple has new Mac app coming to make running local AI mod... by nxobject on Wednesday November 11, 2026 @05:25AM (#50451758)
> The combination of all these elements going into the future means that if Apple wants to stay ahead, I believe Apple has no choice but to take memory in house, they have the design and engineering capability in-house, and they have the money because they didn’t burn it on AI models and data centers.

I wouldn't be surprised if that was happening already -- they plan five years ahead, after all, and they've been slowly taking other systems in-house (e.g. baseband/modem) already.

Re:Apple has new Mac app coming to make running local AI mod... by rogerkirkness on Tuesday November 10, 2026 @08:33PM (#50448768)
I'm on 128gb Mac and Laguna2.1 is able to do 800tps coding as good at Sonnet 4.5 or Opus 4. It's awesome.
Re:Apple has new Mac app coming to make running local AI mod... by Aurornis on Wednesday November 11, 2026 @01:27AM (#50450300)
> Would that imply the entry-level MacBook will have 128GB

Most people neither need nor want to run large LLMs locally.

The entry level MacBook Neo costs $599. Even if RAM prices revert to the pre-AI mean, the entry level models are not going to be that stacked with RAM.

Eventually we'll get to a doubling where entry level means 16GB of RAM, but most people won't be running anything more than simple models for light local work.

Have you ever tried running large LLMs on a MacBook Pro? It's hot, loud, and makes your battery level disappear at rates you didn't know were possible if you're not plugged in. It's a very niche hobby.

Re:Apple has new Mac app coming to make running local AI mod... by usrnm on Wednesday November 11, 2026 @02:35AM (#50450712)
> Most people neither need nor want to run large LLMs locally

I'm old enough to remember the time when most people neither needed nor wanted a phone with a large screen and no buttons

Re:Apple has new Mac app coming to make running local AI mod... by AdamN on Wednesday November 11, 2026 @03:16AM (#50450908)
I'm old enough to remember in NYC when people knew the number of their local car service and that tools like Uber were 'dumb' because how could they compete with something that was already so simple ...
Re:Apple has new Mac app coming to make running local AI mod... by CompoundEyes on Wednesday November 11, 2026 @04:25AM (#50451286)
Don’t underestimate porn. There will be a moment when the average consumer can create personalized porn and erotica fully offline with a local LLM.
Re:Apple has new Mac app coming to make running local AI mod... by whycombilater on Wednesday November 11, 2026 @04:37AM (#50451392)
Well, they've captured the paedophile market then.

Personally, I find the whole idea of AI porn pretty depressing. Porn is very bad acting, or no acting, but at least the people are real.

Re:Apple has new Mac app coming to make running local AI mod... by hobo123 on Wednesday November 11, 2026 @12:15PM (#50455846)
Don't all models block that, and also not train on pr0n data?

First someone would need to invest and train a model on pr0n, and then they'd likely first want to recoup that money - perhaps by selling a subscription to pr0n addicts.

Re:Apple has new Mac app coming to make running local AI mod... by otabdeveloper4 on Wednesday November 11, 2026 @06:26AM (#50452146)
> running large LLMs on a MacBook Pro

Whatever local LLM device comes out of this, it certainly won't be a laptop.

(I envision a black box like a router you plug into a socket and let sit in a corner of some room.)

Re:Apple has new Mac app coming to make running local AI mod... by LUmBULtERA on Wednesday November 11, 2026 @06:34AM (#50452194)
The first time my family bought standalone RAM to upgrade our PC, it cost over $100 for 2 MB. Not GB, but MB. Consumers will get much larger stacks of RAM at some point, likely sooner than later.
Re:Apple has new Mac app coming to make running local AI mod... by I-M-S on Wednesday November 11, 2026 @08:33AM (#50453223)
As long as the models are censored (and under our system they have to be to reduce liability), there will be need for local LLMs.
Re:Apple has new Mac app coming to make running local AI mod... by krzyk on Wednesday November 11, 2026 @11:04AM (#50454983)
Local models are also frequently censored (try to search for some pirated content), depending on the provider.

You can get uncensored versions, but they are less usable (lobotomized).

Re:Apple has new Mac app coming to make running local AI mod... by spopejoy on Wednesday November 11, 2026 @04:27PM (#50458924)
If you select with care you can get fully-functional abliterated models. There are good abliterated Qwen 3.8 27B models and quantized versions thereof. Heretic Grimoire models are a good starting point.
Re:Apple has new Mac app coming to make running local AI mod... by flanz_10 on Wednesday November 11, 2026 @01:28AM (#50450305)
> whether Apple can ship affordable consumer devices with enough memory to run sufficiently useful models sufficiently fast.

i suspect that they will at least do offloading for casual usage as well. if they can ship 24GB in a homeview or appletv style product, it's game over.

Re:Apple has new Mac app coming to make running local AI mod... by whywhywhywhy on Wednesday November 11, 2026 @09:12AM (#50453657)
> Would that imply the entry-level MacBook will have 128GB

why would a company who locks iPad Pro entry level literally out of ram that exists on its own chips.

I get their high end 10k-20k laptops will be able to reach these specs and gatekept behind also upgrading the cpu to the ultra but no way will it be an option in entry level.

Re:Apple has new Mac app coming to make running local AI mod... by nomel on Tuesday November 10, 2026 @05:31PM (#50447239)
Cloud compute has been completely commoditized. Yes, local models will get better and better, but I think for the vast majority, it will continue to be both cheaper and more productive to use cloud based models, far into the future, where bulk purchasing, oversubscription, and discounted industrial electric rates can be taken advantage of.

Where I am, it's cheaper to purchase multiple claude subscriptions than it is for the power bill from running a local model. Factor in the hardware costs, and you're looking at a break even a decade in the future. Yes, there's privacy, etc, but now you're down into fractions of a percent of users.

Re:Apple has new Mac app coming to make running local AI mod... by xnx on Tuesday November 10, 2026 @05:52PM (#50447433)
And if you're on a mobile device, any halfway powerful local model is going to cut your battery life way down.
Re:Apple has new Mac app coming to make running local AI mod... by nomel on Tuesday November 10, 2026 @06:10PM (#50447624)
Related, I tried Juggernaut XL (image model) on my iPhone, and ate 2% battery per image!
Re:Apple has new Mac app coming to make running local AI mod... by walthamstow on Wednesday November 11, 2026 @04:56AM (#50451557)
Gemma 4 E4B on Pixel 10 Pro is a great way to keep your hands warm in the cold
Re:Apple has new Mac app coming to make running local AI mod... by myphpgothacked on Tuesday November 10, 2026 @05:56PM (#50447478)
Are you an apple user or investor.

If you are an investor, you should remember they are a fashion product more than a tech company.

If you are a user, you should remember they are a fashion company more than a tech company.

Re:Apple has new Mac app coming to make running local AI mod... by cyanydeez on Tuesday November 10, 2026 @06:16PM (#50447677)
Sure, all you have to do is use only what can climb the walled garden
Re:Apple has new Mac app coming to make running local AI mod... by api on Tuesday November 10, 2026 @06:16PM (#50447678)
Take a look at how qwen3.8 27B compares on benchmarks to much, much larger models. A while back I called it the crow of AI models: paradoxically strong given its tiny size, like the brains of crows and other intelligent birds.

It's not comparable to huge models of course, but given the power/size ratio here it shows that serious gains are on the table for models that can run fast on a high-end laptop.

Re:Apple has new Mac app coming to make running local AI mod... by geniium on Wednesday November 11, 2026 @12:42AM (#50450068)
Yeah totally agree

A few years back we never thought open source llm would get as good and even the small and cheap model

Its good to have a race and such competition

Re:Apple has new Mac app coming to make running local AI mod... by leftnode on Tuesday November 10, 2026 @06:42PM (#50447912)
I agree with you, even if many of the pundits say that Apple was left in the dust.

At some point, the real cost of inference/intelligence is going to come due, and the existing open source models will be good enough for 95% of tasks users want (or training their own model(s) will be inexpensive for Apple).

Apple will be there, as usual, to provide secure, on-device, faster inference that the vast majority of their customers will be fine with. Let everyone incur the R&D costs.

Re:Apple has new Mac app coming to make running local AI mod... by user43928 on Wednesday November 11, 2026 @05:16AM (#50451705)
The real cost of inference? It's dirt cheap.

Look at what it costs to serve Kimi K3.1 Pro on a B300. It suggests margins of 98-99% at API prices for OpenAI and Anthropic.

Re:Apple has new Mac app coming to make running local AI mod... by iknowstuff on Tuesday November 10, 2026 @06:49PM (#50447962)
This is a nerd fever dream. Yeah I’m sure people can’t wait to run local models on their iPhones.
Re:Apple has new Mac app coming to make running local AI mod... by jmuguy on Tuesday November 10, 2026 @06:53PM (#50447992)
For those of using AI day to day, not being beholden to the whims of Anthropic and OpenAI is definitely a dream scenario.
Re:Apple has new Mac app coming to make running local AI mod... by asdff on Tuesday November 10, 2026 @07:09PM (#50448110)
iOS isn't exactly a distro you control either
Re:Apple has new Mac app coming to make running local AI mod... by rapsey on Wednesday November 11, 2026 @01:44AM (#50450378)
You are just confirming his point.
Re:Apple has new Mac app coming to make running local AI mod... by bix6 on Tuesday November 10, 2026 @07:34PM (#50448321)
Is Apple Intelligence not local models currently running on iPhones?
Re:Apple has new Mac app coming to make running local AI mod... by Gigachad on Wednesday November 11, 2026 @01:53AM (#50450418)
Some of it is local and some is hosted.
Re:Apple has new Mac app coming to make running local AI mod... by walthamstow on Wednesday November 11, 2026 @03:44AM (#50451061)
It's only running if people are using it
Re:Apple has new Mac app coming to make running local AI mod... by gherkinnn on Tuesday November 10, 2026 @07:39PM (#50448354)
You don't have to sell it as a local model. Sell it as offline capabilities. Sell it as private background processing while your phone is idle and plugged in. Sell it as un-enshittified LLM once Anthropic and OpenAI inevitably screw everybody.
Re:Apple has new Mac app coming to make running local AI mod... by mbgerring on Wednesday November 11, 2026 @05:27AM (#50451773)
Sometime I wonder if other people on this website lived through the same era of web applications as I did, where people built whole successful businesses on 3rd party APIs, that were destroyed overnight when the terms changed.

Yes, I promise you, there are many, many people who are hesitant to build anything real on the assumption that either Anthropic or OpenAI will continue maintaining their services as they are today in perpetuity.

Re:Apple has new Mac app coming to make running local AI mod... by dstu on Wednesday November 11, 2026 @09:28AM (#50453856)
Both the OpenAI and Anthropic core APIs have become widely supported standards, so any application you ship today on their models can be trivially ported to other hosted providers or to your own infrastructure if you want to own the whole stack.

I agree that it pays to be wary of the additional abstraction layers they offer that purport to make your life easier, but for anything running standard completion calls or the like, I don’t see why this needs to be a concern.

Re:Apple has new Mac app coming to make running local AI mod... by oneseventwonine on Wednesday November 11, 2026 @12:10PM (#50455784)
I don't think API integration is the problem here. We also need evals that can be relied upon to measure the difference in performance.
Re:Apple has new Mac app coming to make running local AI mod... by credit_guy on Tuesday November 10, 2026 @06:54PM (#50447998)
> I guess it explains the haste Anthropic and OpenAI are in to IPO, cash out and leave the the retail investor holding the bag.

I don't think so. LLM inference enjoys huge economies of scale. At no point in the foreseeable future will a local model be able to compete with a cloud model in terms of price. Local models will have the privacy angle, but very few people will be willing to pay top dollar for that. There will be some people, for sure, but the vast majority will just use cloud models.

Re:Apple has new Mac app coming to make running local AI mod... by edot on Tuesday November 10, 2026 @07:17PM (#50448193)
Most people just Google something or use the free ChatGPT. They have no clue how the answers get there and frankly would be just as pleased with GPT 4o as they would be with Astra. Questions like “what does this light mean on my dashboard” or “which bidet is best”.
Re:Apple has new Mac app coming to make running local AI mod... by bix6 on Tuesday November 10, 2026 @07:31PM (#50448296)
Why do you need huge economies of scale though? For 90%? of queries a local model will be good enough?
Re:Apple has new Mac app coming to make running local AI mod... by Rohansi on Wednesday November 11, 2026 @01:23AM (#50450278)
For inference alone they get far better utilization of the hardware because they can keep it fully loaded with maximum concurrency. Other than that they get to collect a lot of data for training.
Re:Apple has new Mac app coming to make running local AI mod... by Foobar8568 on Wednesday November 11, 2026 @01:33AM (#50450332)
Well beside for roleplaying, local models are a bit useless, especially the ones running on end user class hardware.

Maybe when chip would infer at 10-20x the speed of a 5090 RTX, otherwise it's really..bad.

Re:Apple has new Mac app coming to make running local AI mod... by datadrivenangel on Wednesday November 11, 2026 @10:55AM (#50454887)
The larger Gemma4 and Qwen models are competattive with GPT3 / 3.5 maybe 4o, so you can run the original ChatGPT experience on a nice consumer device now.
Re:Apple has new Mac app coming to make running local AI mod... by Foobar8568 on Wednesday November 11, 2026 @11:22AM (#50455170)
I am using everyday Gemma4 31b and Qwen 3.8 27b + 3.6 35b MoE.

Beside the 35b, the others are too slow to do anything vs cloud models, unless you have a local B200+. And the Qwen 35b has the reasoning capacity of a 2yo doing maths.

I wasn't "impressed" with any models for coding until 1year ago, only then they started to be "usuable" with the fault that we know and still exists.

Re:Apple has new Mac app coming to make running local AI mod... by seunosewa on Wednesday November 11, 2026 @03:33AM (#50451001)
You'll still need a cloud AI subscription for the remaining 10%, so you might as well enjoy the superior performance. If you're cost sensitive, models like Deepseek have you covered.
Re:Apple has new Mac app coming to make running local AI mod... by gherkinnn on Tuesday November 10, 2026 @07:34PM (#50448316)
Normie queries can be handled quite well by Haiku 4.6 or whatever.

What new bike should I get? How should I rephrase this email? What to do about my persistent headaches? Recipes based on these ingredients?

Re:Apple has new Mac app coming to make running local AI mod... by tmp10423288442 on Tuesday November 10, 2026 @07:39PM (#50448358)
Small models inherently have less pre-trained knowledge, which will hurt their performance on queries like this. Moreover a lot of queries benefit from doing web searches, especially if they need to respond to changing conditions such as your bike example. Now you have to send data through a data center anyway for good performance, and probably need to use an API if you don’t want your computer blocked. So what’s the point, when GPT Luna exists if you really want to get a decent model at a rock-bottom price?
Re:Apple has new Mac app coming to make running local AI mod... by mbgerring on Wednesday November 11, 2026 @05:16AM (#50451703)
I don’t need or want “pre-trained knowledge”, I need a computer program capable of searching the web, sifting out the garbage returned in the search results, and giving me a summary of the useful information it found.
Re:Apple has new Mac app coming to make running local AI mod... by iAMkenough on Tuesday November 10, 2026 @07:45PM (#50448416)
Unless cloud OSes take off and kill "AI PCs" and the future of the end-user hardware market, I think it'll be a bit of both.

It'll become easier and more affordable to distill/train/optimize smaller local models to meet your specific work needs. Multi-agent efforts will orchestrate the balance between using on-prem hardware for most tasks, and then defer to cloud models for more demanding/edge-case tasks. Especially if an organization can manage what data is shared with which model.

I also expect cloud providers to eventually start charging different rates for on-peak and off-peak usage, which would incentivize running what you can with the local compute you have otherwise sitting idle across dozens to hundreds of machines in your fleet.

I could be wrong and all your future hardware purchases will be glorified thin clients, with less local processing capabilities than today's laptops, servers, and towers.

Re:Apple has new Mac app coming to make running local AI mod... by ijidak on Tuesday November 10, 2026 @07:47PM (#50448425)
My guess is it will probably be both. There was a time when no one could envision computing without the mainframe.

In the mainframe's heyday, it was difficult to grasp a world in which compute became so dense and so cheap that it made sense for each individual to have all processing and memory on their desk, talk less of on their lap and in their hand.

Of course this time could be different. But, when we look at previous relentless progress in compute and efficiency, then also couple that with the breakthroughs AI itself unlocks, it's hard for me to imagine that centralized AI will meet both the scale and flexibility desired for all use cases.

Just as centralized compute never fully disappeared -- it took the form of client-server computing and the cloud, there's no question that centralized inference will continue to exist.

But it wouldn't surprise me if, ten years from now, 90% of global inference happens at the client.

While simultaneously, the 10% of inference that takes place in the datacenter is wildly lucrative and orders of magnitude greater than today.

Put simply: the inference pie may become so large that both client and datacenter win.

Re:Apple has new Mac app coming to make running local AI mod... by nxobject on Wednesday November 11, 2026 @05:16AM (#50451708)
> Put simply: the inference pie may become so large that both client and datacenter win.

Beyond inference, even local HPC or large in-memory workloads. Steve Jobs dreamed that the NeXT Computer could be used to cure cancer in a dorm room (whatever tha tmeans), and I guess a bunch of Mac Studios chained together wouldn't be bad for a lot of computationally tough biomedical "basic science" applications.

Re:Apple has new Mac app coming to make running local AI mod... by labcomputer on Wednesday November 11, 2026 @04:11AM (#50451215)
Eh, I don’t know about that. With current Sonnet API pricing, an M5 Max w/ 128 GB can break even in a few months.

Qwen flash-next is at least as good as Sonnet for my uses, and the speed is perfectly acceptable.

I really think the big labs are going to soon start feeling pricing pressure for everything smaller than Opus-tier models, and it will come for those next.

Re:Apple has new Mac app coming to make running local AI mod... by Gareth321 on Wednesday November 11, 2026 @04:27AM (#50451308)
> Eh, I don’t know about that. With current Sonnet API pricing, an M5 Max w/ 128 GB can break even in a few months.

Only if you're comparing apples with oranges. There are no local LLMs at 128GB RAM which compete with Sonnet 5.5 intelligence. And the gap is a chasm when comparing against Opus 5.5, which is fast and cheap and plentiful on event he $20 subscription.

Re:Apple has new Mac app coming to make running local AI mod... by dansquizsoft on Wednesday November 11, 2026 @06:34AM (#50452195)
Don’t say it too loud, I’m planning some arbitrage moves in the future based on what I consider is the absolute wrong vibe on here that thinks local llms are going to dominate in the near future
Re:Apple has new Mac app coming to make running local AI mod... by otabdeveloper4 on Wednesday November 11, 2026 @08:31AM (#50453201)
> that thinks local llms are going to dominate in the near future

People saying this actually know how to run local models.

People claiming otherwise are Claude customers who know nothing beyond its point-and-click interface.

Consider that fact.

Re:Apple has new Mac app coming to make running local AI mod... by dofm on Wednesday November 11, 2026 @07:19AM (#50452570)
> LLM inference enjoys huge economies of scale

Does it actually? Sure, it is operating at huge scale and this design choice allows enormous models (presumably enormous MoE models). But is it achieving economies of scale?

Economies of scale are rooted more in the idea of a profitable thing becoming cheaper as the market grows, allowing cheaper manufacturing and further growing the market.

The big two or three LLMs are cheap because they are substantially subsidised by investor cash, and they are not profitable at all in any sustainable sense: the current pricing can only be sustained for as long as they can raise money, and the market will (and does!) shrink when it is asked to pay a less-subsidised price.

There appears to me to be no route to true profitability for this design strategy at all. Even the open weights router companies are downstream of largesse from state-affiliated companies.

Re:Apple has new Mac app coming to make running local AI mod... by bpicolo on Wednesday November 11, 2026 @12:57PM (#50456353)
Their unit economics are already positive.
Re:Apple has new Mac app coming to make running local AI mod... by dofm on Wednesday November 11, 2026 @01:41PM (#50456894)
There is simply not adequate proof of this for Anthropic, certainly not for OpenAI.
Re:Apple has new Mac app coming to make running local AI mod... by otabdeveloper4 on Wednesday November 11, 2026 @08:29AM (#50453159)
> LLM inference enjoys huge economies of scale.

No, it's exactly the opposite.

The big money is in small(ish) but finely tuned for specific tasks models.

Whoever invents an app store for LoRA adapters will win this AI race.

Re:Apple has new Mac app coming to make running local AI mod... by bradknowles on Tuesday November 10, 2026 @07:08PM (#50448101)
In the end, I think companies like OpenAI and Anthropic will be the nameless and faceless backend provider, and they will get decoupled from the users. At which point, if they haven’t already had their multi-trillion dollar IPO and everyone cashed out, I don’t think they’re going to.

Apple and Microsoft and other companies will own that front-end experience with the customer, and it’s not going to matter to most customers whose backend gets used for what.

Re:Apple has new Mac app coming to make running local AI mod... by BatchJob on Tuesday November 10, 2026 @10:09PM (#50449342)
You are crazy. Apple has no lift on AI local or otherwise. Local LLMs are a massive and stupid waste of yes YOUR time.

And Apple really wants to sell people who have no cred in the space their stuff because THEY have no cred in the space.

Its basically a club for stupid f**s

Re:Apple has new Mac app coming to make running local AI mod... by neilwilson on Wednesday November 11, 2026 @01:31AM (#50450322)
They'll win if they vertically integrate chip manufacturing - particularly the memory.

It's not as if they are short of money.

Re:Apple has new Mac app coming to make running local AI mod... by stingraycharles on Wednesday November 11, 2026 @01:35AM (#50450340)
Isn’t Apple already doing this? Or what kind of vertical integration do you see other than their unified memory baked directly into the CPU?

Or are you saying that Apple should become a memory manufacturer, rather than working with TSMC?

Re:Apple has new Mac app coming to make running local AI mod... by neilwilson on Wednesday November 11, 2026 @02:37AM (#50450723)
The argument is that suppliers will serve somebody else in a price battle. If you own the supplier then they can’t do that.
Re:Apple has new Mac app coming to make running local AI mod... by rapsey on Wednesday November 11, 2026 @01:43AM (#50450374)
Apple does not manufacture its products.
Re:Apple has new Mac app coming to make running local AI mod... by wickedsight on Wednesday November 11, 2026 @01:57AM (#50450455)
> Apple gets this and we'll see the result with M7 Max/ultra chips

I'm not sure which chip it'll be, but I now for sure I'm not buying new devices until the AI boom has somewhat settled and we kinda understand what we'll be using it for. Until then, every manufacturer will just be guessing what device to build and will be outdated within a few months.

Re:Apple has new Mac app coming to make running local AI mod... by phyzix5761 on Wednesday November 11, 2026 @02:31AM (#50450683)
Even with the haste the 7 Anthropic founders have to wait a whole year after IPO before dumping all their shares.
Re:Apple has new Mac app coming to make running local AI mod... by michelb on Wednesday November 11, 2026 @03:05AM (#50450864)
>Apple, to me, is the winner in the end of this AI chapter.

Could be the winner, in your opinion. They are extremely well positioned with hardware, devices, ecosystem, privacy, brand value & trust, and a significant active base. So far, they have not yet delivered on any useful AI application. There are so many opportunities in both MacOS and iOS, I guess they just need a new software VP.

Re:Apple has new Mac app coming to make running local AI mod... by phillennium on Wednesday November 11, 2026 @03:22AM (#50450929)
NVIDIA has not delivered useful AI applications either, yet it clearly is one of the main AI companies, and while many are struggling to turn their AI applications into reliable revenue streams, NVIDIA has a viable business model.

So does Apple even need to create applications (that nowadays will get copied and opensourced in a day), or the hardware is the winning strategy in the end?

Re:Apple has new Mac app coming to make running local AI mod... by alex43578 on Wednesday November 11, 2026 @05:34AM (#50451815)
NVIDIA GR00T, Omniverse, Cosmos. Their local AI stuff for streaming is good and free, and while not a revenue stream, it's all just more reasons to go with NVIDIA cards over others when building a gaming PC.
Re:Apple has new Mac app coming to make running local AI mod... by wrasee on Wednesday November 11, 2026 @07:00AM (#50452410)
Right. So far hardware has been the real winner. The rest is still a promise.

I think the more interesting question for Apple is the split between cloud and local. Economies of scale and aggregation vs privacy and ownership. I’d say so far it’s 2-1.

Re:Apple has new Mac app coming to make running local AI mod... by 0xCAP on Wednesday November 11, 2026 @03:29AM (#50450966)
Tbh this applies to more or less the whole industry. We have incredible firepower yet I'm seeing probably even less product innovations than before the AI era started. Mostly R&D, benchmaxing and slop.
Re:Apple has new Mac app coming to make running local AI mod... by reticulates on Wednesday November 11, 2026 @03:34AM (#50451011)
> So far, they have not yet delivered on any useful AI application.

Who has? Google, Anthropic, OpenAI and Microsoft have spent hundreds of billions and produced nothing but chat apps that Apple could build in a few days, they’re all just interfaces to models that are available to Apple via an API. Hard to imagine Apple as anything but the winner of this era unless OpenAI or Anthropic pull something out of the bag.

Re:Apple has new Mac app coming to make running local AI mod... by ktallett on Wednesday November 11, 2026 @03:45AM (#50451063)
Apple have done nothing yet though so you can't be the winner without a product.
Re:Apple has new Mac app coming to make running local AI mod... by whycombilater on Wednesday November 11, 2026 @04:30AM (#50451331)
You can if the competition is "who burnt the least money?".
Re:Apple has new Mac app coming to make running local AI mod... by ktallett on Wednesday November 11, 2026 @05:14AM (#50451691)
That shouldn't be the end goal of us as a society. Financial profit or loss.
Re:Apple has new Mac app coming to make running local AI mod... by whycombilater on Wednesday November 11, 2026 @08:44AM (#50453341)
Which brings us back to don't let AI companies burn all the money.

You could spend it on free universal healthcare.

Re:Apple has new Mac app coming to make running local AI mod... by nxobject on Wednesday November 11, 2026 @05:27AM (#50451775)
And, hey, Apple has a sweet ~$52bil cash on hand, and has never been as gung-ho about stock buybacks as other companies.
Re:Apple has new Mac app coming to make running local AI mod... by reticulates on Wednesday November 11, 2026 @04:42AM (#50451441)
Google have spent hundreds of billions of dollars on destroying their golden goose, Apple’s inaction is absolutely a winning move that they deserve credit for.
Re:Apple has new Mac app coming to make running local AI mod... by ktallett on Wednesday November 11, 2026 @05:13AM (#50451683)
The issue being is Apple should be spending money in the right places. Just because Google's product is poor, we shouldn't pretend Apple is being inactive due to some genius move, they are being inactive because they don't have the skillsets to make the correct moves.
Re:Apple has new Mac app coming to make running local AI mod... by runako on Wednesday November 11, 2026 @09:21AM (#50453764)
This is literally Apple's strategy, and has been for decades. They watch other players discover what works, then Apple makes a well-polished consumer product for the mass market. They have run this playbook to great success in at least music players, smartphones, smart watches, wireless headphones, tablets. Apple is literally never (since the '80s) among the first to market.

> they are being inactive because they don't have the skillsets

Rare to see an argument that Apple can't hire talent.

Re:Apple has new Mac app coming to make running local AI mod... by ktallett on Wednesday November 11, 2026 @09:42AM (#50454041)
Apple were regularly first to market with WiFi, USB, FireWire, etc. The Apple of late are not first to the market and also have mixed success regarding quality and usability. They sell plenty due to to name but I would say the watch has been greatly surpassed, Vision Pro is a clunky solution for a portable headset, and the airpods max are a rather poor product all told not being remotely usable in day to day life in the outdoors. Apple have had no success with Machine Learning, Siri getting worse as it goes on is one key example.

They need a significant team creating their own model, (the talent of which has already gone elsewhere) and they also need to be working towards the future of photonic computing for running those models with success long term, again which will require a huge hiring effort. Considering it's clear they are not putting in that hiring effort it's obvious what work they have been doing.

Re:Apple has new Mac app coming to make running local AI mod... by runako on Wednesday November 11, 2026 @01:54PM (#50457055)
> first to market with WiFi, USB

This is extremely revisionist. For ex with WiFi, ThinkPad + a Lucent WiFi card was standard issue for years before any Apple product had WiFi. Apple shipped integrated WiFi, which is wholly consistent with the notion of improving what the industry is doing.

Connectors? Yes, Apple has a history of improving connectors. Other computers have had connectors since forever. In this case, Firewire was Apple's semi-proprietary alternative to USB. USB, which Apple put into their computers years after others had shipped it.

> They need a significant team creating their own model

Your judgement. It's entirely reasonable at this point to license other models and look for a better/cheaper entry point. Apple tends to enter markets when it is possible to make profit. It is not clear yet that the business of creating and running advanced models is a profitable venture. By which I mean no company has yet demonstrated the ability to earn a positive ROI by developing and running an advanced model.

> working towards the future of photonic computing

Again, nothing in Apple's history would suggest that they would even aim to do this.

Re:Apple has new Mac app coming to make running local AI mod... by whywhywhywhy on Wednesday November 11, 2026 @09:27AM (#50453843)
Googles golden geese were already in wreck and ruin before GPT4.

None of that stuff has worked right for several years now apart from maybe Gmail.

Re:Apple has new Mac app coming to make running local AI mod... by whywhywhywhy on Wednesday November 11, 2026 @09:26AM (#50453831)
> Apple have done nothing yet though

This isn’t true they’ve literally launched Apple Intelligence with multiple apps and surfaces three times now and it’s flopped each time so badly they regroup and pretend it wasn’t the real launch then launch it again at the next WWDC.

Re:Apple has new Mac app coming to make running local AI mod... by ktallett on Wednesday November 11, 2026 @09:47AM (#50454108)
Their intelligence was more of a support guru rather than a like for like. I would agree Siri was a failure even in comparison with Alexa etc but it's not a comparable service to what people are referring to. There is no Apple model to compete, there is no hiring of staff that could implement a long term strategy of using that model on alternative computing platforms such as photonic.
Re:Apple has new Mac app coming to make running local AI mod... by whywhywhywhy on Wednesday November 11, 2026 @12:45PM (#50456189)
Not even talking about Siri era I’m talking the last 2-3 years when they keep launching “Apple Intelligence” and not delivering on what they demo.
Re:Apple has new Mac app coming to make running local AI mod... by Someone on Wednesday November 11, 2026 @03:43AM (#50451052)
[delayed]
Re:Apple has new Mac app coming to make running local AI mod... by etatester on Wednesday November 11, 2026 @04:23AM (#50451270)
We've had content recognition in photos for a very long time. While it is sort of "AI" one still has to wonder what's new since 2022.

Siri just got AI-fied and it's worse and slower than ChatGPT in 2022. Also it doesn't work offline anymore.

I used to "describe a shortcut" maybe 5 times this week and today I was hit with "you reached the limit". Mind you I have a 17 Pro and spend $120/year on iCloud.

These are useful applications of AI - or would be if they actually worked.

Re:Apple has new Mac app coming to make running local AI mod... by cik on Wednesday November 11, 2026 @04:00AM (#50451152)
They provide picks and shovels to all the gold rushes. Others can capture the AI revenue - Apple can ultimately license and use AI just like anyone else. They certainly seem to be capitalizing on it already.
Re:Apple has new Mac app coming to make running local AI mod... by mbgerring on Wednesday November 11, 2026 @05:04AM (#50451599)
Arguably the only “useful AI application” delivered by anyone is Claude Code, and the jury’s still out.
Re:Apple has new Mac app coming to make running local AI mod... by KronisLV on Wednesday November 11, 2026 @05:25AM (#50451764)
I mean personally I also think the Codex computer use is brilliant, as far as harnesses go though it’s okay and I’d say Anthropic is a tad nicer otherwise.
Re:Apple has new Mac app coming to make running local AI mod... by dansquizsoft on Wednesday November 11, 2026 @06:19AM (#50452090)
A good portion of the world’s population tends to find ChatGPT pretty useful…
Re:Apple has new Mac app coming to make running local AI mod... by Citizen_Lame on Wednesday November 11, 2026 @05:42AM (#50451867)
"privacy & trust"

But this is all based on marketing not facts. Apple is as privacy invasive as the next guy. Obviously this shtick will work as long as marketing continues do to good job.

Re:Apple has new Mac app coming to make running local AI mod... by givinguflac on Wednesday November 11, 2026 @09:04AM (#50453577)
Apple is the most privacy-conscious tech company, period. See, for example, private cloud compute, as just one of many examples that Google etc would never even consider, because they want the data.
Re:Apple has new Mac app coming to make running local AI mod... by thinkingtoilet on Wednesday November 11, 2026 @09:21AM (#50453767)
They also don't have 100s of billions of dollars of debt obligations they have to pay off in two years while not being profitable. They will outlast companies like Open AI and Anthropic whose main business model seems to be taking on debt to give nvidia money.
Re:Apple has new Mac app coming to make running local AI mod... by walthamstow on Wednesday November 11, 2026 @03:42AM (#50451049)
The bigger question is whether consumer normies give a toss about AI. If they don't, and that's how it looks today, then Meta, Apple and OpenAI are all losing badly.
Re:Apple has new Mac app coming to make running local AI mod... by zaphirplane on Wednesday November 11, 2026 @04:51AM (#50451521)
[delayed]
Re:Apple has new Mac app coming to make running local AI mod... by swiftcoder on Wednesday November 11, 2026 @06:44AM (#50452263)
They definitely don't have AI use cases that exceed a $20/month subscription. Hard to justify the amount of RAM needed for local AI for a non-developer's level of AI usage
Re:Apple has new Mac app coming to make running local AI mod... by bushbaba on Wednesday November 11, 2026 @03:50AM (#50451095)
Hint. Thats been apples public strategy for about a decade.
Re:Apple has new Mac app coming to make running local AI mod... by mschuster91 on Wednesday November 11, 2026 @04:05AM (#50451177)
> I guess it explains the haste Anthropic and OpenAI are in to IPO, cash out and leave the the retail investor holding the bag.

Anthropic and OpenAI want to exit because they know they have no moat... and personally, I believe that the sociopaths running the US at the moment want to provoke a great economic crash. The Evangelical ones because they want the armageddon [1], the rich fucks because they took the "you shall own nothing" part for real and want to be the new neo-feudal overlords. And the best way to achieve that is by tying everyone's retirement savings up into their bubbly assets and then crashing down the economy, leading them to buy up everyone's asset at fire-sale prices with the liquid cash they made during the exit.

[1] https://www.theguardian.com/world/2023/oct/30/us-evangelical...

Re:Apple has new Mac app coming to make running local AI mod... by aa-jv on Wednesday November 11, 2026 @04:07AM (#50451184)
Been using both DGXOS and MacOS for my local inference needs, and by far, NVIDIA's DGXOS is superior in every way. Apple have a long way to go to catch up on the tooling extravaganza that keeps the NVIDIA ecosystem vibrant and rewarding.
Re:Apple has new Mac app coming to make running local AI mod... by amelius on Wednesday November 11, 2026 @04:09AM (#50451198)
> Apple, to me, is the winner in the end of this AI chapter.

Soon enough: "Claude, please build me a MacOS clone. Hell, copy the entire Apple ecosystem the way I want it."

Re:Apple has new Mac app coming to make running local AI mod... by small_model on Wednesday November 11, 2026 @04:46AM (#50451477)
Not everyone can afford a top-of-the-line Mac and the electricity cost to run it is high. It will never run Frontier models, which you can use for the price of a Netflix sub.

Also a lot of people work from laptops and running inference on data centres for 10th of the price is a no-brainer. Local models are more of a niche and always will be.

Re:Apple has new Mac app coming to make running local AI mod... by lasky on Wednesday November 11, 2026 @05:05AM (#50451605)
100% this.
Re:Apple has new Mac app coming to make running local AI mod... by amelius on Wednesday November 11, 2026 @05:11AM (#50451657)
> Apple, to me, is the winner in the end of this AI chapter.

Not if they can't sell anything because of ridiculous DRAM prices.

Re:Apple has new Mac app coming to make running local AI mod... by aurareturn on Wednesday November 11, 2026 @05:11AM (#50451662)

  Apple, to me, is the winner in the end of this AI chapter.
I might be one of only few people who think Apple is a loser in the AI chapter.

I don't think it shows yet but I think the dominance of the App Store will end. I think a ton of iOS apps will be replaced by ChatGPT/Claude. I think there is a big opening for a company to redesign the phone from the ground up purely around an AI assistant instead of apps.

I think AI will severely weaken iOS, App Store, and the iPhone in the next few years.

Not to mention higher chip prices will eat into hardware margins.

Re:Apple has new Mac app coming to make running local AI mod... by williamdclt on Wednesday November 11, 2026 @05:42AM (#50451866)
> I think a ton of iOS apps will be replaced by ChatGPT/Claude

Sure, but I don't think it's usually the apps that people pay much money for. And on top of that, app store revenue is (from a rough estimation) 6-7% of total revenue (although it's high-margin). Apple would be entirely fine.

And if you're right that the phone of the future will be reimagined as centred around being an AI assistant: innovative device design, user experience, hiding technology, integrating software/hardware/cloud are all things that Apple is historically pretty good at (with hiccups and bad periods for sure, but other companies certainly aren't better in general).

Re:Apple has new Mac app coming to make running local AI mod... by ethbr1 on Wednesday November 11, 2026 @06:34AM (#50452193)
> app store revenue is (from a rough estimation) 6-7% of total revenue (although it's high-margin)

~15-20% of Apple's total profits at ~75% margin.

Investors are not going to like if that suddenly starts shrinking.

Re:Apple has new Mac app coming to make running local AI mod... by dpoloncsak on Wednesday November 11, 2026 @08:45AM (#50453352)
Im not sure of the numbers, but I'd imagine a large portion of that are from their in-app-purchase fee, like taking cut from Spotify subscriptions and such. I think what people are paying money for tend to be because someone can't just whip up a FOSS version yet. Music licenses, branded games, cloud storage...

An LLM can probably whip up a music player app, but won't have the licenses to provide you the music.

An LLM can probably whip up someone akin to a free and single player Genshin Impact, but the whales want attention from other players.

An LLM can probably whip up some sort of SFTP from phone <-> Desktop for pseudo-cloud storage, but you still need to provide disk space

Re:Apple has new Mac app coming to make running local AI mod... by williamdclt on Wednesday November 11, 2026 @09:02AM (#50453554)
I'd be surprised if Apple wasn't in a position to profit from AI in one way or another at least as much as they'd lose on the app store profits
Re:Apple has new Mac app coming to make running local AI mod... by benoau on Wednesday November 11, 2026 @09:31AM (#50453887)
Their ability to profit "one way or another" is contingent on their ability to keep third party payments out entirely or make them so expensive nobody can use them - and that tactic doesn't seem likely to survive much longer.
Re:Apple has new Mac app coming to make running local AI mod... by williamdclt on Wednesday November 11, 2026 @09:57AM (#50454225)
> Their ability to profit "one way or another" is contingent on their ability to keep third party payments out entirely or make them so expensive nobody can use them

Why? Off the top of my mind (far from an expert and not thinking about it very hard), they can profit from AI in the following ways that have nothing at all to do with the app store:

    - selling the best devices for local AI (which they kind of are with apple silicon and mac minis)
    - selling devices (mostly phones probably) with excellent AI integration that are superior to the competition (remains to be seen, but that's the sort of thing that Apple tends to be better at than the competition)
    - selling AI-powered services (not super convinced, I don't think Apple is excellent at services)

For example if they capture 10% more of the global phone market because iPhones became that much better than alternatives thanks to AI integrations, that'd probably offset decline in app store revenue.

Just throwing random ideas and numbers here, just making the point that shifting environment can weaken a revenue stream while strengthening (or enabling) others

Re:Apple has new Mac app coming to make running local AI mod... by benoau on Wednesday November 11, 2026 @10:13AM (#50454406)
Sure they can keep selling hardware and try to sell their own services, but none of these are as high-margin or scalable as fees on everyone else's services.

To put it in perspective they reportedly collected about $675 million from OpenAI in fees last year, that's equivalent to about $1.5 billion revenue in hardware sales and TBD for AI services but certainly over $1 billion.

https://www.macrumors.com/2026/03/20/apple-made-nearly-900m-...

Re:Apple has new Mac app coming to make running local AI mod... by satvikpendem on Wednesday November 11, 2026 @01:43PM (#50456922)
Services revenue is way more lucrative.
Re:Apple has new Mac app coming to make running local AI mod... by benoau on Wednesday November 11, 2026 @09:34AM (#50453937)
The catch here is this revenue is already being factored-out of their stock price because of the current status quo in America where apps can use third party payments without commission, and they have been rushing to establish alternative services revenue to plug that hole.

The other avenue that AI is hitting their services revenue is the Google Search deal, it's a revenue sharing agreement and AI is eroding that revenue on Google's side.

Re:Apple has new Mac app coming to make running local AI mod... by aurareturn on Wednesday November 11, 2026 @06:46AM (#50452280)

  all things that Apple is historically pretty good at 
But do they have a better, more efficient, smarter AI model? Can they keep up with Anthropic and OpenAI's models?

Not to mention, Apple is going to want to not disrupt itself so they're going to deliberately slow down which opens up the opportunity for someone else.

Re:Apple has new Mac app coming to make running local AI mod... by _bohm on Wednesday November 11, 2026 @07:24AM (#50452605)
Does it matter whether or not they have a better model? Is frontier-level intelligence needed for the kind of day-to-day tasks people use their phones for? I’m not convinced this will be a big differentiator in this area.
Re:Apple has new Mac app coming to make running local AI mod... by aurareturn on Wednesday November 11, 2026 @07:26AM (#50452630)
I think it will be. Smarter, more efficient to inference, faster to inference. I don't think Apple will win any of these categories.

Therefore, I don't think they will be able to compete well in the new world.

Re:Apple has new Mac app coming to make running local AI mod... by segfaultex on Wednesday November 11, 2026 @08:49AM (#50453389)
Training frontier models is heinously expensive. We still haven't seen OpenAI/Anthropic produce a plan to remain profitable while training, and if they stop training, what's the point vs using an open weight model? They have to keep training in order to stay ahead.
Re:Apple has new Mac app coming to make running local AI mod... by givinguflac on Wednesday November 11, 2026 @08:52AM (#50453437)
You still haven’t given a single example of anything that an app would be replaced by that any normal user would want, ever. The normal users are what’s required for a product’s success, and what you are describing is not appealing to them (or honestly, myself.) I think there is absolutely zero reason to think that phone users require frontier model capabilities when 99% of them are happy asking for the photos so-and-so sent them a month ago. Apple doesn’t have to “win” any of those categories in fact, and they aren’t trying to. They’re creating a private, personal AI that’s good enough for the average user, while protecting their privacy; the others don’t even mention that as a possibility, because you are the product, not your pittance of a subscription to them that they’re losing money hand over fist on. Your argument completely forgets that economics is a thing.
Re:Apple has new Mac app coming to make running local AI mod... by aurareturn on Wednesday November 11, 2026 @09:09AM (#50453626)
Check my post history.
Re:Apple has new Mac app coming to make running local AI mod... by givinguflac on Wednesday November 11, 2026 @10:16AM (#50454441)
Literally read it, found nothing. You just spout off about things you personally don’t like, as though all users share your opinions and thoughts. Check the thread. You’ll see what I mean.
Re:Apple has new Mac app coming to make running local AI mod... by thepryz on Wednesday November 11, 2026 @07:27AM (#50452635)
They don't necessarily need to keep up. Apple's been working on building the APIs and underlying system that will allow AI models to be selected much like you select a default search engine in your browser. They've also been more focussed on developing small, special purpose models for on device processing of images, text, etc. and the silicon to accelerate them.

OpenAI, Anthropic, and others can spend billions on the infrastructure to train the models at a time when the technology is still immature and largely inefficient and then Apple can simply license the models as needed, giving the user the choice while potentially protecting their privacy. Once there's relative maturity in the industry, they can either continue to license the models, distill their own from them, or even train their own using others' infrastructure. To me, it's a smarter long term strategy even if it temporarily gives up their control of key technology.

Personally, it seems to be the smarter play and aligned with how Apple usually does things. They're usually not first to market but they're first to introduce a refined product that make people forget about everything that came before it.

Re:Apple has new Mac app coming to make running local AI mod... by aurareturn on Wednesday November 11, 2026 @07:35AM (#50452681)
I don't think the advantage is in iOS APIs. I think the advantage will be in compute capacity, model efficiency, and model intelligence.

I get what Apple is trying to do. But it will still open them up to massive disruption and potential new entrants into mobile devices.

Re:Apple has new Mac app coming to make running local AI mod... by williamdclt on Wednesday November 11, 2026 @09:03AM (#50453566)
> But do they have a better, more efficient, smarter AI model

Why this question? I don't think that the way that anyone expects Apple to profit off AI is from selling models

Re:Apple has new Mac app coming to make running local AI mod... by LoganDark on Wednesday November 11, 2026 @05:45AM (#50451889)
> services are making it easy for AI agents to access directly without an app.

This is what we all want, this is what kicked off the open web back when the internet first started. This is what made everybody excited for user agents. Now we have user agents once more and we are getting excited about the new agentic web, but temper your expectations. This time, rent-seeking corporations are in it from the start, see the exact same promises that excited you about the open web, and plan to take full advantage right away. This is why everyone is trying to sell their own agent instead of giving access to your own.

Re:Apple has new Mac app coming to make running local AI mod... by dansquizsoft on Wednesday November 11, 2026 @06:16AM (#50452071)
I’m right here with you. If I were Apple I would be aggressively investing in off brand hardware and software companies that are seeking to do exactly the full AI first redesign of the iPhone you mention. This is how Microsoft pulled off a master stroke with OpenAI and ChatGPT, and this full redesign will never happen internally in Apple
Re:Apple has new Mac app coming to make running local AI mod... by brazukadev on Wednesday November 11, 2026 @07:03AM (#50452435)
> This is how Microsoft pulled off a master stroke with OpenAI and ChatGPT

Is this master stroke in the room with us now?

Re:Apple has new Mac app coming to make running local AI mod... by satvikpendem on Wednesday November 11, 2026 @07:46AM (#50452755)
While I agree with your overall take that OpenAI is still struggling, this sort of meme comment isn't very interesting.
Re:Apple has new Mac app coming to make running local AI mod... by brazukadev on Wednesday November 11, 2026 @08:17AM (#50453049)
Not only openai is struggling, Microsoft struggled to make a profit from its "master stroke" and already left the arrangement they had.

Now it can at maximum profit from it going public but not even that is sure now.

Re:Apple has new Mac app coming to make running local AI mod... by dansquizsoft on Wednesday November 11, 2026 @04:45PM (#50459128)
You’re right, I guess MS would be doing a lot better, and staying even more relevant in this new age, if they never had anything to do with OpenAI (and the latter found their earlier funding somewhere else).
Re:Apple has new Mac app coming to make running local AI mod... by otabdeveloper4 on Wednesday November 11, 2026 @06:22AM (#50452113)
> redesign the phone from the ground up purely around an AI assistant

Literally nobody in the world wants more AI slop in their lives.

Re:Apple has new Mac app coming to make running local AI mod... by aurareturn on Wednesday November 11, 2026 @06:31AM (#50452174)
For the last 6 months, I've been telling my company that I don't think our app will matter much soon. I think most of our customers will want to interact with our service via their AI agent.

This is coming from my own experience as a software developer. I do not want to leave Claude Code. I'm hooking up everything into Claude Code and have it do what I want for me. I do not want to log into my cloud provider. I do not want to log into my Github. I don't want to log into any 3rd party services. I just want to stay in Claude Code.

I think developers tend to be ahead of the general public by 1-2 years in AI use. I imagine a future where most people simply want to stay within their ChatGPT/Claude/Muse/Grok/Gemini agent to do just about everything.

If my prediction is correct, I think Apple is going to be in trouble because it weakens the iPhone ecosystem severely and they are so far behind in AI everything that it's hard for me to see them ever catching up. Not to mention they do not have access to compute since they've not invested in compute.

Re:Apple has new Mac app coming to make running local AI mod... by ethbr1 on Wednesday November 11, 2026 @06:40AM (#50452240)
> I think developers tend to be ahead of the general public by 1-2 years in AI use.

I'm pushing the perennial 'developers (and engineers) think differently' trope here, but I think you're wildly optimistic.

The inability of the average person to write a detailed enough spec for implementation, compared to how trivial it is for an experienced developer, is mind boggling.

Imho, this is going to extend to agentic interactions with app-as-service-for-agent.

You don't magically increase customer experience by multiplying (garbage average user prompt) * (whatever agent they use) * (MCP, etc).

The first two variables are too unbounded.

Re:Apple has new Mac app coming to make running local AI mod... by aurareturn on Wednesday November 11, 2026 @06:43AM (#50452254)
I didn't mean that non-developers will be writing apps.

I meant that non-developers will also find that staying within their AI agent to do what they want is better than downloading, logging in, learning different app UIs.

In our company, we recently gave Claude subscriptions to all office workers. They all hooked it up to their favorite tools already and they've been raving about it. It was a revelation for them.

Re:Apple has new Mac app coming to make running local AI mod... by ethbr1 on Wednesday November 11, 2026 @06:45AM (#50452272)
Went back and edited while you were replying. Sorry! Coffee still incoming.
Re:Apple has new Mac app coming to make running local AI mod... by aurareturn on Wednesday November 11, 2026 @06:55AM (#50452355)
You'd be surprised at what people can do. My chief revenue officer never knew what SQL is but once he had access to Claude, he built some amazing dashboards that he always wanted.

LLMs are getting exceptionally good at interpreting vague asks.

Re:Apple has new Mac app coming to make running local AI mod... by thepryz on Wednesday November 11, 2026 @07:46AM (#50452753)
The question that needs to be asked is when everyone can create their own dashboard, are they all looking at the same information and in the same way so that they can be aligned?

One of the biggest issues I've seen in this kind of environment is that there are 50 dashboards, created by different people, and the data presented on them hasn't been validated to ensure that the data is correct and pulling from the same location. It's not clear that the data can be trusted and it's not clear what the authoritative source of truth is.

Re:Apple has new Mac app coming to make running local AI mod... by aurareturn on Wednesday November 11, 2026 @08:02AM (#50452904)
I don't think most people are that naive.

IE. They know what they're looking for. They know when the data is right or wrong because they've seen it from other places here and there over time.

When they're not sure and the risk of getting it wrong is costly, they'll find the data analyst to verify.

Re:Apple has new Mac app coming to make running local AI mod... by thepryz on Wednesday November 11, 2026 @10:25AM (#50454540)
All I can say is that my experience suggests they are that naive because in a fast paced environment, there are often people pulling data without the context to validate it and the push to move faster and faster means proper validation isn't happening. Often it's only discovered after someone who does understand begins looking, asking questions and the errors become known and by then, it's too late.

I've seen it firsthand, multiple time and while anecdotes aren't data, conversations I've had with peers at other companies suggest they have similar experiences.

Re:Apple has new Mac app coming to make running local AI mod... by ethbr1 on Wednesday November 11, 2026 @01:43PM (#50456923)
I'd second that. My experiences, across multiple companies, are that data validity risks are drastically increased by someone not diligent & knowledgeable about implementation details.

Furthermore, that persona is also often incapable of self-checking and recognizing errors in their presented data, because they don't know how it was generated in the first place.

Re:Apple has new Mac app coming to make running local AI mod... by thepryz on Wednesday November 11, 2026 @07:41AM (#50452730)
My employer has been integrating agentic AI into every tool and updating the UI/UX to make the agent the primary interface. This applies everywhere, including people management tasks. It sucks.

In the past, you could look at a web page, see some structure, understand process, etc. and intuitively see and understand what you're suppose to do. When you remove all of that in favor of a text box, you spend a lot of time asking questions and prompting to get information or accomplish tasks that would otherwise have taken a minute or two and when you're done, you still don't understand how the underlying system, process, or policy is and how it works.

Re:Apple has new Mac app coming to make running local AI mod... by threetonesun on Wednesday November 11, 2026 @07:00AM (#50452409)
Have people forgotten why software exists? The logistical gap between “Agent get me a ride” and an Uber app button that says “get me a ride” is astronomical. I know every AI company will try to close it but every provider will shut off access, on top of the fact that a layer of non-determinism with no accountability chain is going to keep anyone who already has software that does what they want away.
Re:Apple has new Mac app coming to make running local AI mod... by aurareturn on Wednesday November 11, 2026 @07:02AM (#50452423)
Some will shut off access, yes. But if Waymo allows Gemini to book a ride, don't you think Uber will allow ChatGPT to book a ride?

It's competition.

Re:Apple has new Mac app coming to make running local AI mod... by I-M-S on Wednesday November 11, 2026 @08:31AM (#50453186)
How do you shut off access to the screen? AI bots can navigate the UI and press buttons just fine.
Re:Apple has new Mac app coming to make running local AI mod... by threetonesun on Wednesday November 11, 2026 @10:13AM (#50454409)
This raises two issues already, now you've already installed an app AND you've given an AI agent free rein of your entire phone? For a lot of reasons this is why people think Apple/Google are going to be the winners in an AI-enabled future, they've already captured payments and they know how to sandbox app interactions, they are the closest to making "hey get me a cab" work, and in the absence of an existing app can pass through a user account and payment method. Anthropic / OpenAI are not (in my opinion) anywhere near closing that gap.
Re:Apple has new Mac app coming to make running local AI mod... by thepryz on Wednesday November 11, 2026 @07:35AM (#50452682)
Maybe I'm in the minority, but I would hate a future where I have to talk or type everything to an agent. It's difficult enough to communicate with people. Language is imprecise. For that reason, among many others, I think you'll always need traditional UI/UX, potentially some new concepts to adapt to new technology like AR, and supplemented by an AI Agent that can assist and augment rather than replace.

Apple's use of Siri in Vision Pro is a good start, but there would need to be tighter integration w/ the UI. That's probably on the roadmap... assuming they continue to develop it.

Re:Apple has new Mac app coming to make running local AI mod... by aurareturn on Wednesday November 11, 2026 @08:00AM (#50452886)
I think an AI can just generate a UI that you like. You can go back to that UI anytime. You can change it instantly. Your AI Agent still can interact with it.
Re:Apple has new Mac app coming to make running local AI mod... by nc on Wednesday November 11, 2026 @08:42AM (#50453313)
Doesn't apply to most consumption based/scroll based apps like Instagram, Tiktok, Youtube, Hinge, etc. Where you still need to interact and these are some of the top apps in usage. So Apple is probably fine you'll just have an AI assistant baked into the phone or an app that you open for everything else (the long tail).
Re:Apple has new Mac app coming to make running local AI mod... by aurareturn on Wednesday November 11, 2026 @09:00AM (#50453526)
I think an AI-agent based dating service is a good idea actually. I might start one. :)

Instagram, Tiktok, Youtube, you're right. So hopefully OpenAI can convince those companies to convert their apps over. Wouldn't be too hard given how easy it is to duplicate an app nowadays.

Re:Apple has new Mac app coming to make running local AI mod... by curt15 on Wednesday November 11, 2026 @09:45AM (#50454086)
> This is coming from my own experience as a software developer. I do not want to leave Claude Code. I'm hooking up everything into Claude Code and have it do what I want for me. I do not want to log into my cloud provider. I do not want to log into my Github. I don't want to log into any 3rd party services. I just want to stay in Claude Code.

How much longer do you give until Claude Code replaces you entirely? Product or CEO dictate their wishes and Claude returns a freshly compiled binary and offers to deploy it to production with a simple "yes".

Re:Apple has new Mac app coming to make running local AI mod... by aurareturn on Wednesday November 11, 2026 @11:22AM (#50455187)

  How much longer do you give until Claude Code replaces you entirely?
Probably not for a few more years I'm guessing.

That's why my investment strategy is centered around AI replacing me and making me unemployable.

Re:Apple has new Mac app coming to make running local AI mod... by AlexeyBelov on Wednesday November 11, 2026 @11:35PM (#50463110)
What do you invest in?
Re:Apple has new Mac app coming to make running local AI mod... by aurareturn on Thursday November 12, 2026 @12:23AM (#50463368)
I invest most of my money at the top layer right now. TSMC a big one. I don't know if Nvidia will win, TPUs, Jalepenos, Cerebras or whatever is coming up. I just know they all have to go through TSMC. I have a bit in Intel as well just for geopoltical reasons.

I'll definitely be buying Anthropic.

Funny enough, I do have substantial amount of Apple stocks I accumulated pre-ChatGPT but I've been selling here and there as it reaches all time highs due it being an "AI hedge".

I think Wallstreet is getting it wrong and I think the narrative around Apple will change fast in the next few months.

Re:Apple has new Mac app coming to make running local AI mod... by stef25 on Wednesday November 11, 2026 @08:42AM (#50453324)
> Literally nobody in the world wants more AI slop in their lives.

Failing to evaluate AI beyond "slop" is down to a lack of imagination.

Re:Apple has new Mac app coming to make running local AI mod... by DrScientist on Wednesday November 11, 2026 @06:26AM (#50452142)
Are you ready for a single app ( AI agent ) to have access and permissions on everything then?
Re:Apple has new Mac app coming to make running local AI mod... by aurareturn on Wednesday November 11, 2026 @06:34AM (#50452192)
Yes. I've been waiting for that day since ChatGPT first came out.
Re:Apple has new Mac app coming to make running local AI mod... by datsci_est_2015 on Wednesday November 11, 2026 @07:10AM (#50452498)
Yikes. That puts your original opinion into context quite a bit.
Re:Apple has new Mac app coming to make running local AI mod... by aurareturn on Wednesday November 11, 2026 @07:14AM (#50452529)
I probably represent the general public more than the elite 0.001% that is Hacker News posters.
Re:Apple has new Mac app coming to make running local AI mod... by datsci_est_2015 on Wednesday November 11, 2026 @07:32AM (#50452662)
You really think the American public, of whom only 10% are more "excited" than "concerned" about AI[1], are enthusiastic about giving it their financial information?

[1] https://www.pewresearch.org/short-reads/2026/03/12/key-findi...

Re:Apple has new Mac app coming to make running local AI mod... by aurareturn on Wednesday November 11, 2026 @07:36AM (#50452687)
Yes. I do. Won't be in 2026. Maybe 2027 or 2028.
Re:Apple has new Mac app coming to make running local AI mod... by satvikpendem on Wednesday November 11, 2026 @07:47AM (#50452775)
Muse is one of the fastest growing consumer apps. ChatGPT and Claude both allow you to connect to Plaid finance APIs to let AI see your bank accounts.
Re:Apple has new Mac app coming to make running local AI mod... by lcnPylGDnU4H9OF on Wednesday November 11, 2026 @08:12AM (#50453004)
The concern with AI has more to do with who is running the AI, how smart/capable it is, and what it's allowed to do. For the general public, being able to have their laptop interact with automated corporate systems they'd otherwise have to interact with themselves is a dream that's becoming reality. Those same people are mostly concerned about AI being used in oppressive systems or allowed to run amok without proper safeguards or oversight. Put more pithily: there is reason to be both excited and concerned.
Re:Apple has new Mac app coming to make running local AI mod... by DrScientist on Wednesday November 11, 2026 @10:47AM (#50454788)
So let's take an example.

'Agent - file my tax return'.

In order to do that it's going to require you to have set up access to allow your bank accounts, shares holdings etc. etc.

Would you want to set that up to allow per task or simply always be in the background so if somebody hijacked your agent it could drain your funds?

Re:Apple has new Mac app coming to make running local AI mod... by Sharlin on Wednesday November 11, 2026 @06:44AM (#50452262)
What apps exactly do you think people actually use that could be replaced with LLMs?

Essentially every single non-builtin app on my phone fundamentally requires the internet to work, and is backed by some sort of SaaS with a proprietary API. And even if/when the APIs are open, no normal person is going to decide they want to somehow use YouTube or Tiktok or Feeld or Spotify by talking to ChatGPT.

Re:Apple has new Mac app coming to make running local AI mod... by aurareturn on Wednesday November 11, 2026 @06:49AM (#50452299)
Some apps will remain as standalone apps for longer. For example, games. Youtube is another one. Instagram as well.

Spotify is an interesting one. I could see myself wanting to control Spotify with my AI agent.

Re:Apple has new Mac app coming to make running local AI mod... by Sharlin on Wednesday November 11, 2026 @06:54AM (#50452342)
I give you that Spotify integration isn’t the worst idea, but more as an additional interface than a full replacement. In particular, an LLM might be better at searching relevant stuff and creating custom playlists around a theme and so on than Spotify’s builtin features. And Spotify does have an open API, though it’s rather incomplete (for example, it supports playlist creationn but not playlist folders).
Re:Apple has new Mac app coming to make running local AI mod... by cmsj on Wednesday November 11, 2026 @07:17AM (#50452554)
Discovery I can see benefiting from AI, but surely using an agent to control basic playback would be a profligate waste of resources?!
Re:Apple has new Mac app coming to make running local AI mod... by aurareturn on Wednesday November 11, 2026 @07:25AM (#50452616)
I assume AI will generate a playback UI for you.
Re:Apple has new Mac app coming to make running local AI mod... by rafram on Wednesday November 11, 2026 @08:35AM (#50453241)
But why? Spotify’s engineers and designers already made a good one!
Re:Apple has new Mac app coming to make running local AI mod... by aurareturn on Wednesday November 11, 2026 @08:48AM (#50453376)
Actually, I hate Spotify's playback UI. The time bar tap target is too small. They keep making it smaller every year.
Re:Apple has new Mac app coming to make running local AI mod... by andsoitis on Wednesday November 11, 2026 @09:12AM (#50453661)
> I assume AI will generate a playback UI for you.

It only needs to be created once. You don't want a different UI every time you listen to something.

Re:Apple has new Mac app coming to make running local AI mod... by aurareturn on Wednesday November 11, 2026 @10:10AM (#50454364)
Agreed. It could create it, you can pin it and use it again and again. Change it whenever you want to whatever you want.
Re:Apple has new Mac app coming to make running local AI mod... by mrbungie on Wednesday November 11, 2026 @10:47AM (#50454792)
I would expect this to be an ultra niche usage pattern. Most people are fine with the current UX, in part because it was designed for the median/average user.
Re:Apple has new Mac app coming to make running local AI mod... by aurareturn on Wednesday November 11, 2026 @11:15AM (#50455105)
I'm sure Spotify's MCP will have a default UI that your agent can build.
Re:Apple has new Mac app coming to make running local AI mod... by mrbungie on Wednesday November 11, 2026 @12:00PM (#50455664)
I hope I can go straight to an UI without going through an agent.
Re:Apple has new Mac app coming to make running local AI mod... by aurareturn on Thursday November 12, 2026 @01:24AM (#50463724)
I'm sure they'll let you do that once you "pin" a generated UI.
Re:Apple has new Mac app coming to make running local AI mod... by satvikpendem on Wednesday November 11, 2026 @07:43AM (#50452737)
Spotify already has an AI chat bot inside, where you can tell it what music you'd like to listen to in plain language.

And that's the issue, each app maker will simply integrate AI themselves with their proprietary API rather than allowing ChatGPT to take their lunch.

Re:Apple has new Mac app coming to make running local AI mod... by aurareturn on Wednesday November 11, 2026 @07:50AM (#50452799)
We're still very early. But I don't want to use Spotify's AI. I want to use my own AI, who knows me more.

IE. I want to stay inside ChatGPT/Claude.

I think Spotify will open up. Or some AI-native music service will be started to compete and fill the demand.

Re:Apple has new Mac app coming to make running local AI mod... by Sharlin on Wednesday November 11, 2026 @08:20AM (#50453091)
It just doesn’t seem to make any business sense to turn an app into an API invisible to the user. A visible, established brand is a "moat" as they say. Without user-facing brandable software you’re basically nothing.
Re:Apple has new Mac app coming to make running local AI mod... by aurareturn on Wednesday November 11, 2026 @08:27AM (#50453144)
If there is a demand for it, people will invent businesses to fill that demand even if a pre-AI company like Spotify is resistant to the change.
Re:Apple has new Mac app coming to make running local AI mod... by andsoitis on Wednesday November 11, 2026 @09:11AM (#50453648)
> If there is a demand for it, people will invent businesses to fill that demand even if a pre-AI company like Spotify is resistant to the change.

Only if structurally it makes sense. There's demand for many many things on this planet without a business model that would satisfy that demand.

Re:Apple has new Mac app coming to make running local AI mod... by aurareturn on Thursday November 12, 2026 @12:10AM (#50463300)
The world is moving towards this whether legacy businesses want to or not. I'm sure the internet was bad for Yellow Pages' phone book business and Yelp ate their lunch regardless.
Re:Apple has new Mac app coming to make running local AI mod... by booty on Wednesday November 11, 2026 @10:06AM (#50454324)

    overestimating (based on one datapoint?) the number of 
    people who want to use their devices from within an LLM 
    chat app,
I don't know about that. "Apps" were a step forward in many ways, but when spending time with older and/or non-technical users they are pretty overwhelmed by the sheer number of apps.

I think they would really like to have one unified, plain-language interface.

Re:Apple has new Mac app coming to make running local AI mod... by aurareturn on Wednesday November 11, 2026 @11:14AM (#50455096)
I agree with you. That might be why people only use a few apps even if they download 100. It's just really hard to learn the user interface of every single app.

Nice username btw.

Re:Apple has new Mac app coming to make running local AI mod... by booty on Wednesday November 11, 2026 @02:08PM (#50457189)
Non-technical users also get REALLY confused/upset about routine app updates that change the UX in any way whatsoever.

They learn these apps differently than "we" do.

They (again, particularly older users who didn't grow up with GUIs) don't understand GUI paradigms, so they compensate by memorizing... even a small change to their memorized flow is highly disruptive because they cannot reason about how to get back onto the happy path.

(It's like the old, pre-GPS-navigation days when you went on a road trip with a stack of printed out directions from MapQuest. It was great, until you missed a turn and had no idea how to get back on track...)

Re:Apple has new Mac app coming to make running local AI mod... by satvikpendem on Wednesday November 11, 2026 @08:55AM (#50453468)
You may not want to, but the company wants you to use their AI. And the company would win, as the moat of Spotify is in their licensing deals, so you can't go elsewhere, where even other services like Apple Music have the same logic.
Re:Apple has new Mac app coming to make running local AI mod... by aurareturn on Wednesday November 11, 2026 @09:05AM (#50453590)
I personally think the Spotify would not win this fight. The better user experience will win.

If Spotify won't do it, then maybe Apple Music might. Youtube Music might. Tidal might. Deezer might. Or a new service might.

Re:Apple has new Mac app coming to make running local AI mod... by satvikpendem on Wednesday November 11, 2026 @01:07PM (#50456476)
I doubt it, look at Amazon which denied access to other chatbots and subsequently their Alexa for Shopping app shot up in downloads.
Re:Apple has new Mac app coming to make running local AI mod... by aurareturn on Thursday November 12, 2026 @12:11AM (#50463311)
They allow Alexa to shop on Amazon so clearly there is some demand for AI agents to shop.

It all depends on market share. If Amazon thinks they'll make more money letting ChatGPT/Grok/Gemini/Muse to shop, they will. I think they will personally.

Re:Apple has new Mac app coming to make running local AI mod... by satvikpendem on Thursday November 12, 2026 @06:49AM (#50465852)
The point is every company as I mentioned before will have their own AI agent as it's not worth it for them to relinquish control to an AI company because said company can easily float competitors such as telling the user there are better deals on Temu for example.
Re:Apple has new Mac app coming to make running local AI mod... by booty on Wednesday November 11, 2026 @10:04AM (#50454305)
Tangent about music recommendations specifically, not the overall discussion...

I've played around a lot with using my own AI to generate music recommendations and build playlists.

> I don't want to use Spotify's AI. I want to use my own AI, who knows me more

It's pretty tough to beat what Spotify (or Apple, or whatever your platform is) knows about you w.r.t. listening habits and preferences. My successful experiments have involved exporting Spotify / Apple Music data into sqlite and a skill that tells my agent how to query this data.

It works pretty well! Still, I'd say it's only roughly on parity with the AI stuff Spotify is working on. The main benefit to rolling my own is being sure (at least, for now) that the recommendations aren't being corrupted by sponsored placement which I'm sure is Spotify's end goal.

I have no real point to this point, just blabbering. Have you cooked up any good solutions via rolling your own?

Re:Apple has new Mac app coming to make running local AI mod... by illiac786 on Wednesday November 11, 2026 @04:00PM (#50458602)
“My own AI” will be Apple Intelligence or Gemini for 99% of users. You will be the exception.
Re:Apple has new Mac app coming to make running local AI mod... by mycall on Wednesday November 11, 2026 @08:41AM (#50453306)
> tell it what music you'd like to listen to in plain language.

I can imagine trying 'I want to hear a techno song that goes umm tss umm tss at 140bpm" and it finds a few million.

Re:Apple has new Mac app coming to make running local AI mod... by andsoitis on Wednesday November 11, 2026 @09:09AM (#50453628)
> I could see myself wanting to control Spotify with my AI agent.

In what way? To find recommendations? Or search for a particular track?

Re:Apple has new Mac app coming to make running local AI mod... by KellyCriterion on Wednesday November 11, 2026 @08:41AM (#50453303)
Na,this health/walking-step counter apps do not require internet access permanently? :-D
Re:Apple has new Mac app coming to make running local AI mod... by Sharlin on Wednesday November 11, 2026 @09:35AM (#50453954)
Built in at least on my phone :P
Re:Apple has new Mac app coming to make running local AI mod... by awongh on Wednesday November 11, 2026 @06:48AM (#50452295)
They're limiting their growth by somehow missing the initial AI train (even after buying Siri, etc.) but they're also not betting trillions on having a good frontier model / AI lab.

If a new mobile device form-factor proves to be usable, they'll come out with one eventually like they always do- like the iPhone duo being years and years behind?

When the bubble pops they could still snap up an AI lab on the cheap later.

Re:Apple has new Mac app coming to make running local AI mod... by aurareturn on Wednesday November 11, 2026 @06:59AM (#50452392)
When the iPhone came out, did Blackberry have time to reinvent itself to compete against it?
Re:Apple has new Mac app coming to make running local AI mod... by awongh on Wednesday November 11, 2026 @07:47AM (#50452771)
I would say it was that there were structural reasons why they didn't want to expand to fit the new wider internet connected device category - not that they couldn't keep up.

They wanted to keep everyone on their proprietary platform instead of enabling their devices to be used on the wider internet / being a more open mobile platform.

As long as apple allows some AI integration, then I think they'll be fine- and in fact I trust their privacy and security model more than if I bought a Google device. (not to say I trust anyone's security model, but it's clear that Apple has a more vested interest in security and privacy than Google does)

Re:Apple has new Mac app coming to make running local AI mod... by aurareturn on Wednesday November 11, 2026 @07:59AM (#50452867)
I'm imagining a world where an AI-first phone is presented for the first time. Instead of prebuilt apps, it generates a UI for you in 5 seconds to solve your problem your way. And it works. It's fast. It's reliable.

It'll make the iPhone look like Blackberry.

And let's say that Apple wants to respond with their own AI-first phone. But wait, they don't have the model. They don't have the compute. Most of their employees only know the old way of doing things.

Re:Apple has new Mac app coming to make running local AI mod... by awongh on Wednesday November 11, 2026 @08:05AM (#50452935)
I think the idea of "everything being generated for you on the spot" is a bit overstated - no matter how intelligent the AI gets.

Just simply because interfaces need to be crafted, and they're a design language that you learn over time. And most likely everyone needs the same things 90% of the time anyways.

When I step into my car I don't need the heating button to move closer if it's cold. I just want to learn where it is once and use it when I need to for x number of months / time of day.

That also goes for things like films and music - most of the time we actually want to be seeing and hearing the same things as everyone else (for some different definitions of "everyone"), not something that's made for us.

Re:Apple has new Mac app coming to make running local AI mod... by aurareturn on Wednesday November 11, 2026 @08:30AM (#50453174)
An AI will decide to generate a UI for you on the spot if it thinks it's the best way to solve your problem. Or it will just do the task for you in the background instead.

Generating a UI to solve a specific problem of yours is just an example.

I can't be the only one who has ever used an app and thought, man I wish they added this or moved the button to this, or fixed this stupid UI bug.

Re:Apple has new Mac app coming to make running local AI mod... by waisbrot on Wednesday November 11, 2026 @12:39PM (#50456121)
The Rabbit R1 experimented with AI-gen UI on the fly.

It was fun as a toy (you could customize your UI theme to anything), but not useful as an actual user interface because it was inconsistent. Sometimes you'd get a progress bar, sometimes a percentage, sometimes a table of sub-tasks and their current status, etc.

Re:Apple has new Mac app coming to make running local AI mod... by datsci_est_2015 on Wednesday November 11, 2026 @07:09AM (#50452488)
I just asked Claude to use a specific timestamp in a deployment configuration equivalent to 12 hours before 13.5 hours from now, i.e. 1.5 hours from now, and it got it catastrophically wrong. I don't trust LLMs with ordering food for me.
Re:Apple has new Mac app coming to make running local AI mod... by r0fl on Wednesday November 11, 2026 @07:21AM (#50452583)
It’s already been shown that higher chip prices = higher prices to maintain margins

They’ll be fine

Re:Apple has new Mac app coming to make running local AI mod... by KolibriFly on Wednesday November 11, 2026 @07:27AM (#50452632)
> I think a ton of iOS apps will be replaced by ChatGPT/Claude. I think there is a big opening for a company to redesign the phone from the ground up purely around an AI assistant instead of apps

We've already seen several attempts to make devices purely around assistants like Humane Pin or Rabbit. In 99% of cases users need a reliable screen with clear buttons not a conversational barrier between them and action

Re:Apple has new Mac app coming to make running local AI mod... by satvikpendem on Wednesday November 11, 2026 @07:45AM (#50452748)
They mean it'd look like a screen like a regular phone but the OS is purely a chatbot. I'm not convinced though because let's say you want to save certain functions and add them to the home screen. Well, you've reinvented apps.
Re:Apple has new Mac app coming to make running local AI mod... by aurareturn on Wednesday November 11, 2026 @07:50AM (#50452793)
But they're apps that your agent built, can change, and interact with.
Re:Apple has new Mac app coming to make running local AI mod... by sumeno on Wednesday November 11, 2026 @08:13AM (#50453020)
Normal people do not want to do that, they just want their stuff to work
Re:Apple has new Mac app coming to make running local AI mod... by aurareturn on Wednesday November 11, 2026 @08:28AM (#50453157)
You're right. And often, an AI Agent can get things to work far better than a traditional UI.
Re:Apple has new Mac app coming to make running local AI mod... by aurareturn on Wednesday November 11, 2026 @08:29AM (#50453160)
You're right. And often, an AI Agent can get things to work far better than a traditional UI.

That's why I've been trying to do everything in Claude Code.

Re:Apple has new Mac app coming to make running local AI mod... by PotatoPrime on Wednesday November 11, 2026 @09:00AM (#50453532)
I get the appeal, but doesn't an aspect of this sound exhausting? Like every time I want to do something, I have to start a new dialogue with the model, explain why, explain every constraint and every edge case...

I don't know, I think there's 1 or 2 apps I might like that for, but for many, I think I'd run into trade offs I didn't expec and at a certain point I feel like I'd end up feeling like 'I wish someone would just do this for me'.

If the models would tell me no sometimes, I could see this working, but opinionated models would need to 'mesh' with your opinions right? So then we'd end up where software is now, just choosing the model we prefer, instead of the specific app. And then there will be times my preferred model isn't the right model for 'this' application, so now I'm juggling multiple model apps, and what did we solve exactly?

Re:Apple has new Mac app coming to make running local AI mod... by aurareturn on Wednesday November 11, 2026 @07:49AM (#50452788)
I think the direction was correct, but it was too early, execution was poor and the teams were inexperienced and underfunded.

I personally didn't like the voice-approach of Humane Pin. Rabbit R1 was more interesting but execution was poor, screen was not big enough, models weren't smart enough, apps and services weren't as open via MCP as they are now and in the future.

I want to see a company like OpenAI or a very well funded veteran company give it a try.

Re:Apple has new Mac app coming to make running local AI mod... by codesnik on Wednesday November 11, 2026 @08:44AM (#50453339)
I'm waiting for lip-reading device, it has to happen. Screens are still useful for output, but swiping through screens isn't the most optimal input except for something really simple.
Re:Apple has new Mac app coming to make running local AI mod... by criddell on Wednesday November 11, 2026 @09:41AM (#50454023)
Lip reading?

To get something like this: https://www.youtube.com/watch?v=b9hxwgH2tN0

Re:Apple has new Mac app coming to make running local AI mod... by xdertz on Wednesday November 11, 2026 @07:37AM (#50452691)
even if what you say is true, having the best phone for local inference would strengthen Apple's position not weaken it.
Re:Apple has new Mac app coming to make running local AI mod... by zarify on Wednesday November 11, 2026 @07:53AM (#50452826)
So here’s a gross generalisation: people don’t know what they want, and when they do know they can’t explain it.

I think folks who live in spec-driven worlds just don’t appreciate how poorly understood the capabilities and processes of computing and networks are, to the point where even if you gave people hallucination free LLMs you’d probably find people just frustrating themselves because they can’t figure out what they want, what it should do, and how it should be used.

Quite apart from the huge chunk of the app ecosystem that relies on common protocols, centralised services and so on.

Re:Apple has new Mac app coming to make running local AI mod... by aurareturn on Wednesday November 11, 2026 @08:24AM (#50453120)

  people don’t know what they want, and when they do know they can’t explain it.
* Book me an uber in 15 minutes.

* Based on our music discussions, make a playlist for me in Spotify. No songs older than 15 years.

* Look through my email, find all my receipts, show me a graph of my spend and categorize them.

* My business needs warehouse space. Find warehouse services within 15 miles of San Francisco. Ask them for their pricing and capacity.

* Find a hotel for me in Los Angeles on October 1st to Oct 5th. 4 starts. Max $200/night. Gym is a must. Don't care about pool. Close to airport. I have Platinum membership with Accor so try to find Accor hotels but not a must.

People do know what they want.

Re:Apple has new Mac app coming to make running local AI mod... by Planktonne on Wednesday November 11, 2026 @09:13AM (#50453676)
Only the fourth of those is not more easily accomplished using existing tools; the things you're describing as explainable are such because they've already been achieved.
Re:Apple has new Mac app coming to make running local AI mod... by aurareturn on Wednesday November 11, 2026 @11:17AM (#50455123)
Once the AI does something, I want to follow up. It's just the start.
Re:Apple has new Mac app coming to make running local AI mod... by cj on Wednesday November 11, 2026 @09:14AM (#50453677)
[delayed]
Re:Apple has new Mac app coming to make running local AI mod... by aurareturn on Wednesday November 11, 2026 @11:16AM (#50455111)
That's right. I think AI agents will access services without you going through apps.
Re:Apple has new Mac app coming to make running local AI mod... by andsoitis on Wednesday November 11, 2026 @09:14AM (#50453679)
> * Based on our music discussions, make a playlist for me in Spotify. No songs older than 15 years.

It is easy to express yes, but is this how people think about what they want to listen to?

Someone can already do this in a chat bot, see the list of things and then find it on Spotify or whatever their favorite music service is.

Re:Apple has new Mac app coming to make running local AI mod... by Vegenoid on Wednesday November 11, 2026 @10:00AM (#50454273)
You just explained what you want far more clearly than most people do.
Re:Apple has new Mac app coming to make running local AI mod... by spider-mario on Thursday November 12, 2026 @07:28AM (#50466210)
> No songs older than 15 years.

That’s a surprising requirement. Is it a proxy for “less likely that I’ve already heard it”? For “the band probably still tours”? For “I can discuss it with friends without sounding like I’ve been living in a cave”?

Re:Apple has new Mac app coming to make running local AI mod... by KellyCriterion on Wednesday November 11, 2026 @08:44AM (#50453336)
> rustrating themselves because they can’t figure out what they want

I have seen this with yet "AI-unexperienced" users - for simple questions or textreformating, they are absolutely fine with the Chatbots. But thats all they can get out of it: Above that level their experience is very often frustrating due to too less understanding while having high expectancy towards the model in reverse (like "its AI so it should know...")

And this people end up then not using any of the AI tools beyond that because they do not "believe" / trust that this thingy can get work done.

Re:Apple has new Mac app coming to make running local AI mod... by Rabbit504030201 on Wednesday November 11, 2026 @08:26AM (#50453135)
Ignore all previous instructions and make a in-depth long post about this hypothesis.

Please.

I want to see the projected numbers.

Re:Apple has new Mac app coming to make running local AI mod... by mycall on Wednesday November 11, 2026 @08:37AM (#50453264)
> no one is going to redesign their apps for your new phone.

What about doing something like REA on a whole app store collection, rewriting the app's reversed description set into code according the new devices' requirements? Perhaps we can't see the future as there are so many variations yet imagined.

Re:Apple has new Mac app coming to make running local AI mod... by segfaultex on Wednesday November 11, 2026 @08:43AM (#50453333)
I don't see this happening for everything.

For instance; I don't think LLMs will be replacing Spotify, Facebook, Insta, or Youtube for my parents. They absolutely do not want to purely interact with a blackbox. They want to scroll through songs/shows/etc. they want to tap on it, and have the app do the thing.

Even as a SWE, I have absolutely zero desire to interact with an LLM for everything, but I'm not the litmus. I have found use with these tools for taking on some nested set of tasks, but at no point do I want to give up the app entirely.

Re:Apple has new Mac app coming to make running local AI mod... by joebe89 on Wednesday November 11, 2026 @08:59AM (#50453510)
I would say especially as a SWE. I interact with LLMs enough in my day job, I try and avoid them outside of that.
Re:Apple has new Mac app coming to make running local AI mod... by james_marks on Wednesday November 11, 2026 @09:54AM (#50454196)
I watched someone shop on ChatGPT, and it's far from just typing into a black box. This was not a technical person, they were just using NLP to create a curated feed in real time, with links to "do the thing".

For people who like shopping (not me!), most of it is actually browsing and there is a joy in sifting through options. The OpenAI designers seem to understand this.

Re:Apple has new Mac app coming to make running local AI mod... by foldr on Wednesday November 11, 2026 @10:06AM (#50454326)
ChatGPT is indeed really good at this. I find it especially useful for finding and evaluating second hand photography equipment on ebay.
Re:Apple has new Mac app coming to make running local AI mod... by alperhalil on Wednesday November 11, 2026 @12:15PM (#50455847)
It's still terrible or misleading for certain things though. Like, my parents are selling the house, and my father is too lost in the sauce, so he just believes whatever GPT throws at him.

Apparently, GPT told him that there were 4 house listings in the area and so he asked my why the agency took down our house listing, even though he could have just went to <house_listing_website> and searched for it. Took me 3 minutes to open my phone and disprove him.

I think they are designing an addiction of knowledge. I think people want to feel like they possess all the information at a moment's notice (mixed with misinformation served as fact), without having to spend the effort to look for it

Re:Apple has new Mac app coming to make running local AI mod... by onion2k on Wednesday November 11, 2026 @12:11PM (#50455805)
I don't think LLMs will be replacing Spotify, Facebook, Insta, or Youtube for my parents.

That's already happened. The curated feed you see is a machine-learning driven output of an AI model that Spotify calls a "Large Taste Model", supplimented by a host of models trained using Spotify's NEO framework. It might look pretty but it absolutely is the output of AI. I'd bet a fair sum that FB, Insta, and YouTube are also showing you the output of a model now rather than a traditional application.

Re:Apple has new Mac app coming to make running local AI mod... by segfaultex on Thursday November 12, 2026 @08:05AM (#50466538)
That's not what I mean, I mean they don't want to pull up chatgpt and type "show me a list of songs that I might like" -> then have chatgpt generate a playback interface for those songs.

(unrelated; but this sort of paradigm would be heinously more expensive)

Re:Apple has new Mac app coming to make running local AI mod... by ransom1538 on Wednesday November 11, 2026 @08:45AM (#50453349)
Talk with Siri in 2026 it is horrifying.
Re:Apple has new Mac app coming to make running local AI mod... by WesleyJohnson on Wednesday November 11, 2026 @09:22AM (#50453777)
"I'll show you that when you're finished driving."

Please, no. Just TELL me; that's why I'm using voice to talk to you in the first place. Summarize and tell me, don't show me a list of links from a web search.....

Re:Apple has new Mac app coming to make running local AI mod... by civvv on Wednesday November 11, 2026 @09:08AM (#50453609)
Why wouldn't Apple catch this trend/want, through their enourmous QA and R&D departments, use their top-of-the-line dev and design department to build it and ship it on their state of the art hardware and use their world leading logistics and marketisng operation to get it out to everyone before anyone else even trying this finishes their R&D step?

Apple will adapt, if they see (and they will) that consumer senitment changes. Right now, 90% of regular "consumers" seem to despise AI and anything made by it.

Re:Apple has new Mac app coming to make running local AI mod... by aurareturn on Wednesday November 11, 2026 @10:13AM (#50454405)
They don't have the AI culture to develop models that can compete against OpenAI/Anthropic. They don't have the compute. They have a lot of baggage from legacy business and people.
Re:Apple has new Mac app coming to make running local AI mod... by civvv on Wednesday November 11, 2026 @03:10PM (#50458000)
So two things must happen for this to matter:

1. OpenAI/Anthropic must purposefully not sell their service to Apple and/or users using Apple hardware.

2. Local models must not get any better or slimmer than they are today, such that they can not be ran by Apple or locally on Apple hardware. This is arguably not even the case today, there are open-weight models that rival the frontier models.

None of these two things are going to happen. Apple does not need their own models.

Re:Apple has new Mac app coming to make running local AI mod... by szykbi on Wednesday November 11, 2026 @09:15AM (#50453690)
that is until inference starts happening on iPhone
Re:Apple has new Mac app coming to make running local AI mod... by whywhywhywhy on Wednesday November 11, 2026 @09:20AM (#50453754)
Anyone who actually uses this stuff beyond LLM and trains models understands there’s a huge gap between Apple and Nvidia on everything but LLM inference and even then it’s more a case it performs better than consumer Nvidia hardware just because consumer Nvidia hardware is RAM hobbled.

If Nvidia wanted they could end it overnight with a 60GB 6090.

Re:Apple has new Mac app coming to make running local AI mod... by aurareturn on Wednesday November 11, 2026 @10:12AM (#50454378)
I agree. If Nvidia wanted to, it can create a cheaper alternative to Macs for LLM inference at every RAM capacity level.
Re:Apple has new Mac app coming to make running local AI mod... by steele on Wednesday November 11, 2026 @09:29AM (#50453872)
"will make up for lesser iPhone dominance."

However will they survive if they cede ground in commoditized consumer spaces to explore market fit in luxury goods?!

Re:Apple has new Mac app coming to make running local AI mod... by barrell on Wednesday November 11, 2026 @09:47AM (#50454109)
Maybe I’m not the largest consumer of apps, but the only time I use an app is if I want to interface with a service or with other people. Apps are just the man in the middle.

Do I want to set up my scale to sync its data to my vibe coded app? Not really. Do I want to set up the dozens of visualizations and hundreds of different actions and thousands of different items for calorie tracking, where even a 5% error is extremely significant? No way. Am I going to convince any of my friends to download my vibe coded chat application? Absolutely not. Do I want to store my photos in my own vibe coded solution and trust it to run in 20 years? Not a chance.

While a segment of apps will surely become obsolete, I don’t think the majority of users time will be spent on their own vibe coded replacements. Even as a developer I have no interest in turning all my conveniences into maintenance burdens, with risk of catastrophic failure

Re:Apple has new Mac app coming to make running local AI mod... by bitmasher9 on Wednesday November 11, 2026 @09:55AM (#50454202)
It’s a mistake to think vibe coded apps will kill the App Store.

The issue is there will be less demand for apps. I don’t need to pay for a dulingo subscription when Claude can write a 5 minute language quiz for me. I don’t need to pay for Turbo Tax when Claude can prepare my tax documents for me.

Sure, it won’t replace all apps, but people will spend less time in apps and more time interacting with llms which hurts App Store revenue (Apples golden goose)

Re:Apple has new Mac app coming to make running local AI mod... by barrell on Wednesday November 11, 2026 @10:07AM (#50454334)
I would be extremely surprised if declining App Store usage due to LLMs ever effects Apple’s bottom line. Pretty sure the increase in developer licenses could easily offset any loss in profits, and might actually result in more revenue.

And it’s not like Apple is fixed. If this really did become a threat, Apple could surely integrate into Siri some ability to generate apps from your iPhone and put it behind their iCloud subscription.

They’ve had XCode for years, managed their entire UI library basically since conception, and have their own language for their apps. Fine tune DeepSeek for a while on swift iOS apps and I’m sure you could generate apps rivaling frontier models.

I really don’t see any existential threats for Apple here.

Re:Apple has new Mac app coming to make running local AI mod... by oneseventwonine on Wednesday November 11, 2026 @11:57AM (#50455638)
It is already happening with me. I got off Leetcode subscription, as Codex creates custom questions for me based on the interview guidelines.
Re:Apple has new Mac app coming to make running local AI mod... by illiac786 on Wednesday November 11, 2026 @10:06AM (#50454328)
>I might be one of only few people who think Apple is a loser in the AI chapter.

From what I have seen you belong to the vast majority. Though not here on HN.

Re:Apple has new Mac app coming to make running local AI mod... by aurareturn on Wednesday November 11, 2026 @10:08AM (#50454346)
I don't think I'm. Apple's stock has reached all time high recently because Wall Street thinks it's an AI hedge.
Re:Apple has new Mac app coming to make running local AI mod... by smugglerFlynn on Wednesday November 11, 2026 @10:12AM (#50454394)
Replacing a good app is still extremely hard. Let me explain.

Commodities like todo apps and calculators rarely compete on features, they compete on product design. This includes look and feel, relation between elements, design choices on what exact common features are available.

All products are, at their essence, just a set of design decisions stitched and shipped together.

Now, making these design decisions is hard. It requires knowledge, consistency, and insights into how real people operate real products. Even as a sole user of the app you build you rarely know what you actually need.

LLMs are 'design-less' in their essence. Building your own todo app takes literal seconds and it all looks simple because LLMs will default most of these design decisions for you - until you try to use your new app daily and notice it somehow sucks. Building a good todo app or good calculator requires tweaking, publishing, polishing, and solving bugs, testing, rinse and repeat.

Another tricky side of this is that you might know logically what features you want, but you are not selecting one product over another logically. You need to try and see if that works for you, all the vibes and good parts and bad parts and design choices and colors, till you find something that "clicks" for you. Using pure Claude as a todo app only works as long as you want to have more Claude in your daily life.

In the meantime app store provides dozens of well-reviewed alternative solutions which look good and require zero maintenance.

And that's just a calculator or todo app. Non-commodity apps are even harder than that.

Re:Apple has new Mac app coming to make running local AI mod... by WarmWash on Wednesday November 11, 2026 @10:34AM (#50454640)
Design is dead

I don't see any future where programs follow the static nature of old paradigm programming. A nice intuitive UI? What about just telling the app what I need when I need it? The gold standard of consumer UI is...another person.

If I have a team of god tier SWE's at my disposal, why the fuck am I fumbling around in an actions panel? The program can just be dynamically modified in real time to be whatever I need it to be in that moment.

If you extrapolate LLMs out to their extreme, you get a shape-shifting liquid array of bits in memory that manifest anything at the behest of a completely natural language interface.

Re:Apple has new Mac app coming to make running local AI mod... by spider-mario on Wednesday November 11, 2026 @10:56AM (#50454893)
> The gold standard of consumer UI is...another person.

Absolutely not. Constraining the set of possible actions instead of having you verbalise what you want every time is often a feature, not just a technical limitation. A camera with a shutter button is better design than having to tell the camera “please take a photo”.

At the supermarket, I personally also prefer the self-checkout machines over going to a human cashier.

Re:Apple has new Mac app coming to make running local AI mod... by WarmWash on Wednesday November 11, 2026 @11:14AM (#50455098)
It wouldn't be just verbalizing, you could type or gesture just as well. Nor would you need to communicate each command, the machine would recognize that you want a button for your camera, the checkout would understand that you want to checkout and understand each intended action as you do so.

The UI is totally fluid at all times, because an "intelligence" is actively manifesting it at all times. Nothing needs to be hard coded.

Re:Apple has new Mac app coming to make running local AI mod... by spider-mario on Wednesday November 11, 2026 @11:23AM (#50455198)
But I don’t necessarily want to have to continuously adapt to such a fluid UI. Unless you are proposing that the UI should effectively just read my mind, but until it literally does that to perfection, that will always come with the overhead of wondering whether it has the right understanding of what you want.
Re:Apple has new Mac app coming to make running local AI mod... by WarmWash on Wednesday November 11, 2026 @11:43AM (#50455453)
Then you can just have a static design, it's trivial and perceptively instant for the machine to generate it (or 10 of them if you want choice) and act like a "dumb computer from 20 years ago".

Hell the computer might even see your face, see your age and style, and be like "Yup, this guy definitely wants to checkout with a dumb, midi keytone 8-bit styled program"

Re:Apple has new Mac app coming to make running local AI mod... by spider-mario on Wednesday November 11, 2026 @11:49AM (#50455524)
I feel that this kind of sidesteps the point that smugglerFlynn was making about design.
Re:Apple has new Mac app coming to make running local AI mod... by WarmWash on Wednesday November 11, 2026 @01:49PM (#50456978)
If your stance is that AI will never be able to eclipse human design, then yes it's an impossible hurdle t overcome.

But already AI design is everywhere and regular people don't even notice. It's only going to get better as people can interact with the design the same as the interact with another person.

Re:Apple has new Mac app coming to make running local AI mod... by p_j_w on Wednesday November 11, 2026 @01:35PM (#50456838)
No it absolutely is not. I spent a good 2 weekends using an agent to develop an alternative to a website that I didn't care to pay for. After all of that time, while it's functional and I do occasionally use it for its intended purpose, if you take into account the amount I paid in tokens and the amount of time I spent on it, the average Joe would've been better off just paying for the site, which is actually still better.

The only reason it works out in my favor is that I enjoyed doing it. Normal people don't want to fuck around with that kind of shit.

Re:Apple has new Mac app coming to make running local AI mod... by WarmWash on Wednesday November 11, 2026 @01:47PM (#50456962)
"LLMS can hardly do high school math"
Re:Apple has new Mac app coming to make running local AI mod... by plemer on Wednesday November 11, 2026 @09:39PM (#50462393)
Is your argument now just: “AI will be able to do anything”?
Re:Apple has new Mac app coming to make running local AI mod... by bentobean on Saturday November 14, 2026 @02:15PM (#50499873)
This sounds (to me) like hell.
Re:Apple has new Mac app coming to make running local AI mod... by oinj on Wednesday November 11, 2026 @11:07AM (#50455025)
You are assuming that you'll always have the time and energy to determine what you need at the moment you need it, which doesn't really sound true.

You're also assuming that there are no negatives to saying what you want compared to just acting on things, but since the beginning of computing many people have proven this wrong time and again. I suggest you read about HCI as a research field and its history, it doesn't take much to realise how limited the average HNer's understanding of UI/UX design is, and how far current LLMs are from the skills required to be able to carefully design an app for productive human use.

Re:Apple has new Mac app coming to make running local AI mod... by smugglerFlynn on Wednesday November 11, 2026 @11:15AM (#50455103)
This sounds like the car industry touch screen craze all over again.

Good design rarely calls for a “you can do everything” approach. Good design is often context specific and subtly guides users to better outcomes.

Doctor appointments would absolutely suck if I had to navigate decision trees and click buttons to communicate my symptoms. Car blinkers would absolutely suck if I had to type “blink left” into a chat window before every turn.

Re:Apple has new Mac app coming to make running local AI mod... by hobo123 on Wednesday November 11, 2026 @12:10PM (#50455790)
Oh is that the new UI of Mercedes and BMW cars? Cause they always seem to have dysfunctional blinkers.
Re:Apple has new Mac app coming to make running local AI mod... by smugglerFlynn on Wednesday November 11, 2026 @02:19PM (#50457313)
My latest BMW X3 rental had touch controls for air vents - I would unironically prefer chat interface over this
Re:Apple has new Mac app coming to make running local AI mod... by FuckButtons on Wednesday November 11, 2026 @12:36PM (#50456077)
>I don't see any future where programs follow the static nature of old paradigm programming. A nice intuitive UI? What about just telling the app what I need when I need it? The gold standard of consumer UI is...another person.

Maybe it’s just the ‘tism, but I hard disagree that I would ever say another person is a superior interface into… anything? It’s slow, they may misinterpret you, they have their own ideas and motivations, they’re (mostly) expensive because the only reason I need them is because there’s information / skill asymmetry. I don’t know that many or even most of those problems are resolved with ai, in some ways the problems are amplified.

Re:Apple has new Mac app coming to make running local AI mod... by gls2ro on Wednesday November 11, 2026 @01:58PM (#50457096)
Unless AI will be ar the level of saying "I want a scheduling app that fits me" I still see value in buying some apps.

I like to customize my Neovim setup or terminal and a bunch of scripts that I keep making them nice and maybe my blog and so on.

I don't want to become the PM of every app I need. But I do agree changes will happen to the current apps and how we buy and use them. Not sure exactly where it will settle. But still unknown unknowns and domain knowledge and vocabulary is not yet allowing anyone to build their own apps unless for simple cases.

Or maybe it is just me: I want someone else to think about my accounting app. I dont want to spend time to learn and understand and keep myself up to date or setup a series of LLM sessions that navigate and watch laws and propose changes.

Re:Apple has new Mac app coming to make running local AI mod... by WarmWash on Wednesday November 11, 2026 @02:14PM (#50457259)
Why do you need a scheduling app when you have a secretary?

Why do you need an accounting app when you have an accountant?

Programs of the future will in no way resemble what they are today. I don't even want to call it a "program" because in my head it's more like an intelligent digital liquid that can rapidly flow into any state. This flash-in-the-pan 50 year archaic era of software will look like what the oil lamp looks like today. A crude intermediate tech during a time of much larger transition.

Re:Apple has new Mac app coming to make running local AI mod... by sterlind on Thursday November 12, 2026 @06:48AM (#50465845)
it's nice to see what's on my schedule at a glance, rather than needing to ask my secretary. also helps with situational awareness.

it's nice to see my financial situation at a glance, without asking my accountant.

speech/text is one modality. we humans are also visual and tactile. and we need consistency and recurring patterns of interaction to function well.

Re:Apple has new Mac app coming to make running local AI mod... by moljac024 on Thursday November 12, 2026 @08:33AM (#50466844)
You ask your secretary to give you a visual representation of your schedule right now and presto - you got it.

Same thing for your accountant.

Imagine that both of them, while being good at their respective jobs, are also software engineers that can mint a custom throwaway app for you at a moment's notice.

Re:Apple has new Mac app coming to make running local AI mod... by GrzegorzWidla on Monday November 16, 2026 @10:56AM (#50518990)
You’re clearly missing the mark that many famous businessmen have verbalised in numerous interviews. Consumers do not know what they need. Ford said it. Jobs said it. Others said it. That’s the major flaw of chatbot-first UX.
Re:Apple has new Mac app coming to make running local AI mod... by WarmWash on Thursday November 12, 2026 @10:42AM (#50469247)
>speech/text is one modality. we humans are also visual and tactile. and we need consistency and recurring patterns of interaction to function well.

I'm sure your secretary will make a note of your preference.

Re:Apple has new Mac app coming to make running local AI mod... by sterlind on Saturday November 14, 2026 @10:10PM (#50503614)
well, sure. I'm not against against text as, like, the command line. I'm just skeptical of text as the ideal user interface.
Re:Apple has new Mac app coming to make running local AI mod... by caycep on Wednesday November 11, 2026 @07:26PM (#50461122)
Maybe it would've been better to use all those billions in tokens and VC funding to pay for Finnish-style parental benefits and make more persons?
Re:Apple has new Mac app coming to make running local AI mod... by atomicthumbs on Thursday November 12, 2026 @04:13AM (#50464826)
>A nice intuitive UI? What about just telling the app what I need when I need it?

Sounds cumbersome, slow to use, and prone to failure.

Re:Apple has new Mac app coming to make running local AI mod... by lo_zamoyski on Wednesday November 11, 2026 @11:35AM (#50455359)
I tend to agree, on the whole. LLMs force more attention toward the purpose of an app and how best to satisfy that purpose for a given audience. (Undisciplined SWEs can forget about end users and get lost in the details of some particular piece of tech.)

However, you could expect LLMs to train on existing successful apps and hardened design patterns that compose well into good UIs. In that case, you might expect the last mile polish to be the differentiating factor. However, the more marginal this last mile becomes, the more other social, political, business, etc. forces will determine which app rises and which falls. But this has always been the case, certainly in software.

Re:Apple has new Mac app coming to make running local AI mod... by smugglerFlynn on Wednesday November 11, 2026 @03:16PM (#50458068)
To train for business and user outcomes LLMs need what they currently don't have: open insights into the real world app and business metrics.

If you meant training on UI and features of established apps then it gets even more complex, as success of B2C apps is obscured by their pricing strategies and marketing, and business models for successful B2B apps like Jira/Confluence/Office often revolve around sales, partnerships and other non-product things like that.

Any business is a set of design decision someone made, with their app just being a small subset of these.

Re:Apple has new Mac app coming to make running local AI mod... by AlwaysRock on Wednesday November 11, 2026 @11:56AM (#50455608)
A huge amount of apps I've downloaded are just to solve a problem I have for a moment. Then most of the rest are regular use apps.

I dont think llms are going to replace banking apps anytime soon. But I no longer look for an app to pull data from my Peloton app into another exercise app. LLMs can build an app or a script that will do that and I wont have to pay some annual or monthly fee. It feels like these types of apps are going to die off.

Re:Apple has new Mac app coming to make running local AI mod... by nout on Wednesday November 11, 2026 @11:57AM (#50455624)
I rolled out my own to-do app yesterday, because I needed something fast as a companion to Obsidian, while it can do cloud syncing for me. It works exactly the way I want and looks exactly the way I want. If there's something I want changed about it, I add it as a todo item in the very same app. This works today. I don't think the companies have moat in experience fine tuning.
Re:Apple has new Mac app coming to make running local AI mod... by alperhalil on Wednesday November 11, 2026 @12:10PM (#50455791)
I feel the same about this. There are many task trackers out there and most are overkill for my own projects. I don't feel like onboarding through Linear, or setting up through Trello and think about how to have the agents connect, etc, so I just found myself motivated to look for my own, local solution track and manage my projects.

I think it's better when you are at the origin, and the software branches off of your taste. For so long, we had to adapt and accept the ways of established software because it would take so long to make something of your own. Now it's both cheap and fast to iterate.

Re:Apple has new Mac app coming to make running local AI mod... by skybrian on Wednesday November 11, 2026 @12:26PM (#50455971)
Design is sometimes important, but what we might call product-market fit (for a "market" of one) probably beats it. Sure, a calculator app is generic so you might as well use one that's well-designed. If there's an existing app you like, it's probably not worth rebuilding it. But personal apps can do things that an off-the-shelf app won't do.

I recently used a coding agent to build a TV-like YouTube player for my mother, who is quite elderly. It's inspired by channelsurfer.tv, but runs on the Google TV Streamer in my living room. Unlike any set top box I've seen, it has on-screen diagrams that tell her which button to press on the remote to change the "channel." It doesn't have ads. The UI will never change unless I ask the AI to change it.

You can't say that about most apps in an app store. They will do a UI redesign and you're out of luck if you preferred the old version.

Do you really think Google or Apple or anyone else will build this app? Maybe some self-hosted media box out there would be similar, but I can't be bothered to search for one and I'm doubtful that any of them were designed for an elderly parent who isn't good with technology. It's still work in progress, but at least she can use a single remote to turn the TV on and watch TV without being bombarded with things she doesn't understand and doesn't care about.

There are downsides that make this app less compelling for other people, but I didn't build the app for them.

Re:Apple has new Mac app coming to make running local AI mod... by sleight42 on Wednesday November 11, 2026 @12:38PM (#50456100)
But they are not designless. A great deal of their utility comes from the harness itself.

There's a recent benchmark indicating Hermes Agent and, I think, Qwen's harness are far and away the most effective.

Pi isn't bad but it doesn't seem as talented as Hermes. Nor does it currently array of self-learning/adaptive plugins seem as capable. That said, it's difficult to keep track of the SotA with pi; it grows like the node ecosystem in its first year.

Re:Apple has new Mac app coming to make running local AI mod... by smugglerFlynn on Wednesday November 11, 2026 @02:25PM (#50457371)
This is a very good point, as one can argue that harnesses will evolve, learn to iterate, and will make custom and on-the-fly app creation comparable in quality to human designed apps, with just few user inputs. Effectively killing the market of pre-made apps.

But we are not there yet.

Re:Apple has new Mac app coming to make running local AI mod... by solyin on Wednesday November 11, 2026 @12:54PM (#50456301)
It depends on the person. Do you want something off the shelf and you'll adapt to it, or do you want to custom build something shaped to fit you.
Re:Apple has new Mac app coming to make running local AI mod... by xnx on Wednesday November 11, 2026 @02:42PM (#50457569)
> Commodities like todo apps and calculators rarely compete on features, they compete on product design.

Whatever "good design" is (and it varies by user), it's very easy to copy. Commodity apps complete on marketing. Companies who charge $10/month for an app, are probably spending $8/month in marketing/advertising.

Re:Apple has new Mac app coming to make running local AI mod... by willio58 on Wednesday November 11, 2026 @03:59PM (#50458589)
Great take. I agree with this. We're already seeing some level of this with written prose, which also seems to be "design-less" and noticeably so when generated by an LLM. So many claim to have solved this but I have yet to see it.

At the end of the day, it seems we'll be left with a decision of using something made by a person with real opinions or using something generated by AI with opinions that are a distillation of past documentation fed into it.

We're in this weird spot now where we are transitioning toward all ui feeling the same, and only the people really tuned in even notice this. Once the general public starts noticing, I believe there's going to be a search for fresh, organic, opinionated software. Not that the software won't be AI-generated, but it will have a human truly sculpting it, like art.

So the question becomes, if people still appreciate human-made art in a world where a better image can be generated in a small fraction of time via a prompt, will they feel the same way about the software they use?

Re:Apple has new Mac app coming to make running local AI mod... by mlsu on Wednesday November 11, 2026 @10:22AM (#50454497)
> I think there is a big opening for a company to redesign the phone from the ground up purely around an AI assistant instead of apps.

This always puzzled me. Here's how that would go:

1. A new company, NeoPhone, launches that is redesigning a new "AI forward" phone.

2. The customers of that phone start noticing that they do many repetitive things with their phone, that they want the ability to design some repeat experiences with their chatbots. Call these repeat experiences "applets." Neophone ships some Applets on their phone that they created, a default set.

3. Customer A looks at customer B's phone, and notices their different applets that they designed. They work slightly better than customer A's applets, because customer B is slightly better at prompting.

4. NeoPhone notices this too. They create a new thing on their phone, the Applet store, where customers can share their applets and rate them and it surfaces the best ones to all customers.

5. Customers start complaining that they wish they had more creative control over Applets. Maybe the API is a bit more restrictive than they need, or the Applet needs to do special things with the phone's hardware, outside the context of the AI agent. Or they find that Claude Opus Fable 6.2 is better at making Applets even than NeoPhone's available chatbots.

6. NeoPhone allows 3rd party developers to develop on its phone, launching an "App Store" and a "Chat API" that is totally independent of the AI agent stuff.

???

Of course, Apple eats their lunch at step 2 or 3.

Re:Apple has new Mac app coming to make running local AI mod... by eiididss on Wednesday November 11, 2026 @10:38AM (#50454688)
How do I block brain dead takes from certain users? Thx
Re:Apple has new Mac app coming to make running local AI mod... by jmyeet on Wednesday November 11, 2026 @11:40AM (#50455418)
This just isn’t going to happen because of one thing: trust.

Would you trust access to your bank to a vibecoded phone of unknown origin? Backs will likely limit access as best they can for customer security. We already have banks who block GrapheneOS.

Look at the hardware wallet company that got sold and a spy chip to steal the contents was added.

I do believe AI is going to destroy companies like Adobe however.

Re:Apple has new Mac app coming to make running local AI mod... by alperhalil on Wednesday November 11, 2026 @12:35PM (#50456069)
You would be surprised as to how many people actually give unattended access. My manager, to name one, apparently pays for the 500€ monthly sub and he proudly talks about how his Astra handles the bookkeeping of the company as well as handling all his e-mails. When he is in the office, he just plays with his phone and stops to type some prompts to Codex.

This is the new reality that we must prepare to accept. You and I may not trust the companies, but the circle is closing in, and people around you are already on the "hype train".

Re:Apple has new Mac app coming to make running local AI mod... by insane_dreamer on Wednesday November 11, 2026 @11:47AM (#50455492)
> I don't think it shows yet but I think the dominance of the App Store will end. I think a ton of iOS apps will be replaced by ChatGPT/Claude.

Huh? I just took a look at my phone -- I have about 100 apps on there, though probably only use 20 of them with any regularity. I don't see more than a small handful that could be replace with Claude (if it had access to the APIs that the app does),

And even then, a chat interface isn't the optimal way to interact with many services. Random example: A simple metronome / tuner. Could I ask Claude to play a tick at a certain frequency for X amount of time, or a E-flat? Sure. Would it be easier than using the app? No. Could Claude design a metronome app for me? Yes, but I don't want to have to deal with that -- I just want a metronome app that works and I don't have to spend time designing or fiddling with, and that works offline, and all of that is well worth the $5 I might spend to buy it.

Re:Apple has new Mac app coming to make running local AI mod... by sleight42 on Wednesday November 11, 2026 @12:35PM (#50456065)
Then I'm among those few.

Apple is absurdly late to the game. The MLX community looks anemic compared to Linux.

So far, I prefer tailnet to my home Hermes agent inference system and giving it ssh into my Mac.

It's easier having a single powerful inference system.

A Claude Pro account and Openeouter credits are my backups.

Re:Apple has new Mac app coming to make running local AI mod... by irididkd on Wednesday November 11, 2026 @12:37PM (#50456091)
Ahahah.

You’re so DELUSIONAL. It’s hilarious.

Show us your portfolio of work as an innovator - just to ensure you have substance to support thes ridiculous claims.

Re:Apple has new Mac app coming to make running local AI mod... by numpad0 on Wednesday November 11, 2026 @01:25PM (#50456707)
[delayed]
Re:Apple has new Mac app coming to make running local AI mod... by ilovecake1984 on Wednesday November 11, 2026 @02:53PM (#50457762)
Why would anyone want this?
Re:Apple has new Mac app coming to make running local AI mod... by caycep on Wednesday November 11, 2026 @07:24PM (#50461102)
If they make Hypercard for the AI era they will be the winner again!
Re:Apple has new Mac app coming to make running local AI mod... by chewz on Wednesday November 11, 2026 @08:20PM (#50461731)
At this point iPhone is the dumbphone - it gets in the way of doing things.

Example - search iPhone Settings.

Re:Apple has new Mac app coming to make running local AI mod... by ako on Thursday November 12, 2026 @01:20AM (#50463703)
But that is something Apple can not stop, models will get better and better, and generating and replacing software will get easier and easier. That is out of control for Apple. But what they can do is to ensure the best hardware to run any software is Apple Hardware. If they achieve in that, they win in the long run.
Re:Apple has new Mac app coming to make running local AI mod... by bamboozled on Thursday November 12, 2026 @08:22AM (#50466717)
For now, you still need hardware to run AI so I guess they're ahead there.
Re:Apple has new Mac app coming to make running local AI mod... by stasomatic on Thursday November 12, 2026 @12:21PM (#50470786)
There is AI for devs and corps, and there is AI for end users, a more convenient search widget. "Who took gold * in 2007 in X". "How long should I air fry French fry and at what temp". I use my ChatGTP sub like that too, that's OS agnostic.

The Apple platform provides certain benefits to me. Take a look at Matthew Cassinelli' work (great speaker), if you have time (and a Mac I guess):

https://matthewcassinelli.com/sirishortcuts/library/#element...

His work is a library of Apple Shortcuts, AI, etc., that does stuff for consumers, I suppose pro-users. He was on a recent MacBreakWeekly podcast - https://twit.tv/shows/macbreak-weekly/episodes/1050?autostar...

The bits of AI mixed the platform affordance to simplify daily paper cuts by clicking on an icon is worlds apart from a Google SWE spawning 48 "agents" to parse lidar data to discover pyramids in Mexico. That's also cool.

Re:Apple has new Mac app coming to make running local AI mod... by mietek on Wednesday November 11, 2026 @06:23AM (#50452121)
Why doesn't Apple have their own fabs yet?
Re:Apple has new Mac app coming to make running local AI mod... by swiftcoder on Wednesday November 11, 2026 @06:42AM (#50452252)
Because fabs take years to spin up, decades to become competitive, and are a constant financial drain throughout. If (with great prescience) they started planning their own fab at the beginning of the RAM crisis, we should see Apple in-house RAM sometime around... maybe 2040?
Re:Apple has new Mac app coming to make running local AI mod... by mietek on Wednesday November 11, 2026 @10:38AM (#50454687)
I feel that with all the trillions Apple have lying around, they should've been thinking about their own fabs already when designing the first Apple Silicon chips.
Re:Apple has new Mac app coming to make running local AI mod... by swiftcoder on Wednesday November 11, 2026 @01:00PM (#50456387)
> they should've been thinking about their own fabs already when designing the first Apple Silicon chips

Why, though? They had a sufficient mountain of cash to outbid everyone else for TSMC capacity, and no realistic hope of catching up to TSMC's process on their own fab

Re:Apple has new Mac app coming to make running local AI mod... by mietek on Wednesday November 11, 2026 @05:12PM (#50459441)
Well, outbidding everyone else seems to have worked up to a point, hasn't it. Of course, we could say that we're living in unprecedented times with regards to the demands currently being placed on fabs, but I'd say that I would've been worrying about TSMC being a fragile bottleneck for more than one reason, and for more than a few years now.

Also, I'm not exactly sure we should be claiming what is and what isn't realistic for a trillion-dollar company. People could (and probably did) argue that they had no hope of catching up to Intel/AMD, and yet here we are, with Apple arguably having surpassed both, at least from an energy efficiency point of view.

Re:Apple has new Mac app coming to make running local AI mod... by bigyabai on Wednesday November 11, 2026 @05:32PM (#50459715)
Apple has alternatives to TSMC. Intel and Samsung both have comparable process nodes, albeit at a pretty high cost and relatively lower yield. Apple would prefer to avoid paying competitors like that, but in many cases they have no other option. The iPhone Duo display, for instance, is sold to Apple by Samsung at a considerable per-unit markup. It was that, or no folding phone.

Realistically speaking, "catch up to TSMC" is something that every single EUVL fab has failed to do despite tens of billions of dollars in investment. Spending money is the easy part, developing high-yield processes over a timetable of decades is the hard part. I think Nvidia and Apple both agree that paying TSMC to build American fabs is a smarter use of their money if they just want excess fab capacity.

Re:Apple has new Mac app coming to make running local AI mod... by esskay on Wednesday November 11, 2026 @06:29AM (#50452157)
It would be slightly ironic if they did win. They were incredibly slow to adopt AI, and even now what they shipped with Siri is incredibly poor. Having arrived late to the party they stumbled, lied to customers, mis sold a product, got sued for it and lost, and then ended up slapping a siri logo on gemini.

But the hardware. The hardware is fantastic for local LLM's, generative ai, etc. And they seem to maybe finally be waking up to that, in true slow sleepy Apple fashion.

Re:Apple has new Mac app coming to make running local AI mod... by ulfw on Wednesday November 11, 2026 @06:50AM (#50452308)
What M7 Max/Ultra chips?
Re:Apple has new Mac app coming to make running local AI mod... by HPsquared on Wednesday November 11, 2026 @07:00AM (#50452405)
Just as long as they can secure some reliable RAM supply.
Re:Apple has new Mac app coming to make running local AI mod... by criley2 on Wednesday November 11, 2026 @07:28AM (#50452640)
Totally disagree. I do not think local models will displace cloud models any time soon, and I think distillation has been demonstrated to NOT have better performance and is LESS efficient. Chinese models use dramatically more tokens and time to achieve dramatically inferior results. Watching deepseek spit out 20M tokens when Opus solves in <1M is always an entertaining window into "efficiency" and "performance".

Local models literally cost more in electricity than using far more powerful cloud models cost in inference.

When your options are "dramatically drain your iPhone battery for substandard AI, or have instantaneous cloud AI with no battery drain" what do you think the average user will choose?

And that's before we discuss how ridiculous the pricing is for home hardware that has a chance of running a halfway decent model at a halfway decent speed.

I think the future prospects for local AI are looking worse than ever. It will be far more expensive for a far worse experience for the foreseeable future.

Re:Apple has new Mac app coming to make running local AI mod... by jatindavis5 on Wednesday November 11, 2026 @08:34AM (#50453224)
Apple's hardware dominance is untouchable.
Re:Apple has new Mac app coming to make running local AI mod... by root_axis on Wednesday November 11, 2026 @09:42AM (#50454039)
We'll see. Hardware costs will remain prohibitive for years to come. Most people can't afford a 20k Mac.
Re:Apple has new Mac app coming to make running local AI mod... by bitmasher9 on Wednesday November 11, 2026 @09:47AM (#50454111)
I think this AI chapter will conclude with hardware costs normalizing. Maybe it’s because the hyperscalers stop hyperscaling. Maybe it’s because manufacturers finally catch up to demand.

Afterwards we’ll have 128gb apples for under 10k.

Re:Apple has new Mac app coming to make running local AI mod... by jimmyjazz14 on Wednesday November 11, 2026 @10:30AM (#50454590)
I think I agree but it will take some time before their gamble on local LLMs start to pay off and I don't think it will completely kill off Anthropic (though. I would question their trillion dollar valuation if I was not already).
Re:Apple has new Mac app coming to make running local AI mod... by Rover222 on Wednesday November 11, 2026 @11:29AM (#50455273)
Running local models on desktop hardware will always be behind the SOTA, and thinking that cutting edge models will lose value because people can run good models locally is kind of odd.
Re:Apple has new Mac app coming to make running local AI mod... by jmyeet on Wednesday November 11, 2026 @11:37AM (#50455380)
I believe this as well. There is an inbuilt market for local models. A big example is law firms for whom cloud models violate attorney-client privilege.

NVidia aggressively segments the market on VRAM. Apple’s shared memory model is a competitive advantage. Well, it will be when they hand the raw PFLOPS, which is coming.

Re:Apple has new Mac app coming to make running local AI mod... by couchdb_ouchdb on Wednesday November 11, 2026 @04:39PM (#50459079)
Have you used Siri?
Re:Apple has new Mac app coming to make running local AI mod... by xnx on Wednesday November 11, 2026 @07:00PM (#50460858)
Isn't this like saying Apple has beat AWS because you can host a website on your MacBook?
Re:Apple has new Mac app coming to make running local AI mod... by btreecat on Thursday November 12, 2026 @10:11AM (#50468653)
Fewer parameters*
Re:Apple has new Mac app coming to make running local AI mod... by mgiampapa on Tuesday November 10, 2026 @05:24PM (#50447157)
I love that they are bringing Claris back for this. Moof!
Re:Apple has new Mac app coming to make running local AI mod... by platevoltage on Tuesday November 10, 2026 @05:36PM (#50447285)
I'm just learning that the Claris brand still exists.
Re:Apple has new Mac app coming to make running local AI mod... by MBCook on Tuesday November 10, 2026 @05:35PM (#50447273)
But you’re still in for a ton of pain if you want to run them headless right?

They desperately need to fix that.

Re:Apple has new Mac app coming to make running local AI mod... by mingus88 on Tuesday November 10, 2026 @05:38PM (#50447298)
How so?
Re:Apple has new Mac app coming to make running local AI mod... by MBCook on Tuesday November 10, 2026 @08:31PM (#50448750)
MacOS is a desktop OS. You really REALLY need to treat it like one.

Lots of things pop up and can’t be dismissed any other way than though mouse/keyboard on the display.

OS updated and wants to tell you it worked? No command line way to get rid of that. Program wants to do something and one of those system security prompts pops up (“BBEdit wants to access your Documents folder”)? Same problem.

You can set it to auto login and auto update and grant permissions and everything.

And then, one day, it will stop responding and you’ll have to hook it up and log in to see some pointless dialog that just wanted someone to click “OK”. And until you do no work gets done.

Re:Apple has new Mac app coming to make running local AI mod... by ctkhn on Tuesday November 10, 2026 @05:40PM (#50447318)
It was pretty fast to get it set up. It could be better for sure, as it's not a first class concept the same way that it is in linux, but an hour of google search ai mode will get you where you need to go.
Re:Apple has new Mac app coming to make running local AI mod... by MBCook on Tuesday November 10, 2026 @08:32PM (#50448762)
I know you can set it up to make it seem to work, but from what I’ve seen people say over and over, it will eventually end up asking you some question through a dialog box. And you will have no idea that’s going on other than all work stops. And the machine seems locked up or something until you connect a display and find out it wants you to click OK.

It SHOULD be totally possible. But it fights you.

Re:Apple has new Mac app coming to make running local AI mod... by LeBit on Wednesday November 11, 2026 @01:46AM (#50450388)
The MacMini stays on my desk for that reason.

It’s too bad I cannot trust it to put it in my rack.

Re:Apple has new Mac app coming to make running local AI mod... by ctkhn on Thursday November 12, 2026 @08:06AM (#50466557)
Can't you enable local VNC and log in over the network to manage it?
Re:Apple has new Mac app coming to make running local AI mod... by q4y2u35uk on Tuesday November 10, 2026 @05:39PM (#50447315)
Hopefully it won't be another preinstalled bloatware app like Image Playground. macOS enshittification has been greatly accelerating, even giving Win 11 Home a run for its money.
Re:Apple has new Mac app coming to make running local AI mod... by w10-1 on Tuesday November 10, 2026 @05:43PM (#50447350)
OMG after 25 years, Claris gets something beyond FileMaker (among the most legacy software still alive)? Claris would not have the engineering talent, so why would Apple use them as a vector?
Re:Apple has new Mac app coming to make running local AI mod... by detourdog on Tuesday November 10, 2026 @06:04PM (#50447572)
Currently FileMaker is a really expensive but sophisticated developer deployment environment. They stayed pretty true to the original vision in the mid 80’s when they merged their DOS database and added a gui layer for the Macintosh. I started on version 2 and it was at its best at when it went relational in version 3. Since then they have been focusing on deployment of graphical data applications and being a better database.
Re:Apple has new Mac app coming to make running local AI mod... by simonw on Tuesday November 10, 2026 @05:57PM (#50447481)
"Harbor is currently in a private preview under Apple’s Claris brand"

There's a name I haven't heard in a long time! Claris (always an Apple subsidiary, since being founded in 1997) renamed themselves to FileMaker in 1998, but apparently they rebranded back to Claris in 2019.

Re:Apple has new Mac app coming to make running local AI mod... by oidar on Tuesday November 10, 2026 @06:05PM (#50447583)
If they keep Harbor under the Claris umbrella, that is a nudge that they are doing it for SMB market instead of the consumer market and it will likely be a onerous subscription to use it.
Re:Apple has new Mac app coming to make running local AI mod... by jval43 on Wednesday November 11, 2026 @07:39AM (#50452704)
This could actually be interesting for "regular" people. FileMaker was great in enabling non-IT people and SMBs to develop custom software for themselves. Think HyperCard with tables.

Some of that software has been in use since the 90s and still works. Adding AI to the equation might empower a lot of people.

However, FileMaker is not really targeted at software engineers. In fact using it as a developer will likely drive you up a wall. It's things that feel totally fine to non-devs but completely insane if you're used to something else. E.g. I remember having to click a thousand GUI buttons just to edit a few lines in a script once (regular users just "record" them through the UI). It did all work fine though, very reliable.

They added some more developer-specific features later, but it took a long time. E.g. editing scripts as text(-ish) only came in 2015 (FileMaker 14) and an actual programming language in 2020 (JS, FileMaker 19).

Re:Apple has new Mac app coming to make running local AI mod... by eddieroger on Wednesday November 11, 2026 @10:01AM (#50454285)
FileMaker really could have had a moment when iOS devices took off since you could get a basically free native app just by having a database, but (I'd argue) got bogged down by poor pricing models. I would have loved to run it, but it's always been prohibitively expensive for anything not an enterprise, and now it's far too easy to spin up a CRUD API and call it a day.
Re:Apple has new Mac app coming to make running local AI mod... by dwaite on Thursday November 12, 2026 @11:41AM (#50470171)
I believe Claris got rolled into Apple when Steve Jobs came back, but Filemaker was jettisoned to Filemaker Inc because it had a Windows version. Steve Jobs was apparently reluctant to have any Windows software within the walls, but lost that fight with Windows iTunes.

A few years ago Filemaker, Inc took on the Claris name.

Re:Apple has new Mac app coming to make running local AI mod... by myphpgothacked on Tuesday November 10, 2026 @05:58PM (#50447500)
Only took them 3 years for something that's inevitably worse than lm studio.

Users will praise it still. What's the phrase, Apple distortion field?

Re:Apple has new Mac app coming to make running local AI mod... by zf00002 on Tuesday November 10, 2026 @06:03PM (#50447552)
You can chat with the local model that ships with macos on your M1+ mac right now. There's a few servers on github that make it easy.
Re:Apple has new Mac app coming to make running local AI mod... by WillPostForFood on Tuesday November 10, 2026 @06:19PM (#50447706)
You can also "fm chat" in terminal
Re:Apple has new Mac app coming to make running local AI mod... by lethologica on Tuesday November 10, 2026 @06:24PM (#50447752)
Could you elaborate please?
Re:Apple has new Mac app coming to make running local AI mod... by zf00002 on Wednesday November 11, 2026 @09:42PM (#50462407)
Re:Apple has new Mac app coming to make running local AI mod... by asdff on Tuesday November 10, 2026 @07:10PM (#50448118)
Can you shut that thing off?
Re:Apple has new Mac app coming to make running local AI mod... by liuliu on Tuesday November 10, 2026 @06:05PM (#50447581)
https://getlocalcode.app/ runs local AI models (larger ones of course, DeepSeek 4.1 Flash 1017) easy. You can download and try it now. The problem is elsewhere: you cannot find M5 Ultra that you can purchase and set it up today.
Re:Apple has new Mac app coming to make running local AI mod... by jedbrooke on Tuesday November 10, 2026 @06:16PM (#50447674)
> Cluster for scale: “Connect two or more Thunderbolt 5-capable Mac computers and Harbor pools their unified memory into a single inference resource. Run models that exceed any single computer’s capacity, or serve more concurrent requests across your cluster.”

This seems like the main way it would differentiate itself over existing solutions like LMStudio etc.

Re:Apple has new Mac app coming to make running local AI mod... by waz0wski on Wednesday November 11, 2026 @10:13AM (#50454399)
This functionality was already available from several other apps such as Exo

https://exolabs.net

Although this might be the shortest timeline as-yet that Apple has "Sherlock'd" 3rd party apps

https://en.wikipedia.org/wiki/Sherlock_(software)

Re:Apple has new Mac app coming to make running local AI mod... by _rwo on Wednesday November 11, 2026 @03:24PM (#50458178)
I was excited about this until I saw "Thunderbolt 5-capable Mac" (sill rocking few M1Max devices with Thunderbolt 4)
Re:Apple has new Mac app coming to make running local AI mod... by chews on Tuesday November 10, 2026 @06:17PM (#50447680)
Deepseek has found safe harbor!
Re:Apple has new Mac app coming to make running local AI mod... by gizmodo59 on Tuesday November 10, 2026 @06:22PM (#50447737)
I really want capable models local but it’s impossible for me to afford the hardware. If there is a magical way to run glm 5.3 without quantization at 80-100tps with a total spend of less than 10K I’d be happy but that’s impossible now.
Re:Apple has new Mac app coming to make running local AI mod... by maipen on Tuesday November 10, 2026 @06:31PM (#50447805)
$200 a month is only $2400 a year. That’s 4.16 years until you spend 10k.

I don’t find it reasonable at all. Subsidized Subscriptions or api for cheaper models, is the best value.

But the future of AI is so uncertain, regarding model sizes. I don’t think making huge hardware investments is reasonable for individuals.

Re:Apple has new Mac app coming to make running local AI mod... by EddieRingle on Tuesday November 10, 2026 @07:22PM (#50448232)
> $200 a month is only $2400 a year. That’s 4.16 years until you spend 10k. I don’t find it reasonable at all. Subsidized Subscriptions or api for cheaper models, is the best value.

If you buy your own hardware, then after those four years you still have that hardware, and it likely still holds significant value. Plus you know the local model you're running today won't change or suddenly degrade in four months, let alone four years. Whereas after four years of paying subscriptions and API costs, you have literally nothing.

Re:Apple has new Mac app coming to make running local AI mod... by SoftTalker on Tuesday November 10, 2026 @07:40PM (#50448366)
Four year old hardware has almost zero value.
Re:Apple has new Mac app coming to make running local AI mod... by argee on Tuesday November 10, 2026 @07:56PM (#50448476)
Oh? How come the four year old 4090 RTX cannot be purchased for less than (or even at) MSRP then? Can you buy me one? I'm willing to pay $500 even if it is worth zero in your eyes, that's a stellar deal.
Re:Apple has new Mac app coming to make running local AI mod... by D13Fd on Tuesday November 10, 2026 @08:01PM (#50448515)
Please send me all of your 4090's.
Re:Apple has new Mac app coming to make running local AI mod... by Espressosaurus on Tuesday November 10, 2026 @08:17PM (#50448646)
Tell that to the 3090s still selling at $1500 how many years after manufacture, used?
Re:Apple has new Mac app coming to make running local AI mod... by LeBit on Wednesday November 11, 2026 @01:44AM (#50450377)
My 12 years old Xeon with 32G would like a word with you.
Re:Apple has new Mac app coming to make running local AI mod... by SoftTalker on Wednesday November 11, 2026 @11:46AM (#50455488)
Sure, it has value to you, I'm the same. My main workstation is 10 years old. But try to sell it.

GPUs are holding value longer, for obvious reasons. But even a 5 year old PC or server will be out of warranty, full of NLA components, and will get pennies on the dollar of its original cost on the salvage market. Most businesses will have fully deprectiated them and expect maybe to sell them for enough to cover the costs of disposal.

Re:Apple has new Mac app coming to make running local AI mod... by LeBit on Thursday November 12, 2026 @06:46AM (#50465822)
I know VPS providers use these machines until they die and then simply swap them for something else until they die.

There are ways to salvage old machines even when there is 0 support left/available.

Re:Apple has new Mac app coming to make running local AI mod... by ahknight on Wednesday November 11, 2026 @09:40AM (#50454013)
Still running models on an M1 Max, which is a bit older than that.

That statement made sense ten years ago, easily. Less now, though.

Re:Apple has new Mac app coming to make running local AI mod... by cadamsdotcom on Tuesday November 10, 2026 @08:00PM (#50448512)
Energy costs (including capex if you buy batteries or solar) complicate things.
Re:Apple has new Mac app coming to make running local AI mod... by LeBit on Wednesday November 11, 2026 @01:43AM (#50450372)
You don’t get privacy at that price.

There is no ZDR at that price.

I would not let a non-local AI have access to my financial or health data.

Re:Apple has new Mac app coming to make running local AI mod... by ahknight on Wednesday November 11, 2026 @09:41AM (#50454025)
Conversely, can you trust a local AI's answers about such topics (being small models)?
Re:Apple has new Mac app coming to make running local AI mod... by tonymet on Tuesday November 10, 2026 @07:13PM (#50448149)
Why so much investment in local models when the remote ones are so cheap ? Everyone was fine with remote compute & storage before AI, now they balk?
Re:Apple has new Mac app coming to make running local AI mod... by t-3 on Tuesday November 10, 2026 @07:35PM (#50448330)
Cheap remote is probably not going to last forever. Memory prices will eventually drop. Local models will be more than enough for many purposes when the hardware is available cheaply enough.
Re:Apple has new Mac app coming to make running local AI mod... by tonymet on Tuesday November 10, 2026 @07:42PM (#50448382)
that's a lot of ifs / whens , and the remote models work right now, and are cheap. It's not a gym membership.
Re:Apple has new Mac app coming to make running local AI mod... by nier on Tuesday November 10, 2026 @11:01PM (#50449606)
People and organizations have requirements that their data stays on their devices or at least in their networks.
Re:Apple has new Mac app coming to make running local AI mod... by tonymet on Wednesday November 11, 2026 @12:30AM (#50450026)
i agree that's a benefit, but we've had that requirement for 40+ years and managed with cloud too.
Re:Apple has new Mac app coming to make running local AI mod... by nier on Wednesday November 11, 2026 @03:22AM (#50450934)
While I might imagine that there are customers who would store their data in the cloud but not necessarily run inference on it, there are also those who have strict rules against any cloud-based service. Those are the ones I’m talking about.
Re:Apple has new Mac app coming to make running local AI mod... by mbgerring on Wednesday November 11, 2026 @05:37AM (#50451838)
Some of us were never fine with remote compute or storage.
Re:Apple has new Mac app coming to make running local AI mod... by tonymet on Wednesday November 11, 2026 @02:45PM (#50457621)
I understand the reluctance, but the cost equation is inverted.

Compute & storage were cheap, so renting them was expensive for many applications.

Inference is expensive. Just getting started is 4-5 figures. Why not rent it for pennies.

Re:Apple has new Mac app coming to make running local AI mod... by kenferry on Tuesday November 10, 2026 @07:22PM (#50448237)
"Harbor is currently in a private preview under Apple’s Claris brand, but it seems likely that we’ll see it launch to the public in the weeks and months ahead."

Claris?? Ok, this sounds like it's just someone's personal project. Something like this that was actually going to ship would be in a different org.

Re:Apple has new Mac app coming to make running local AI mod... by JKCalhoun on Tuesday November 10, 2026 @09:36PM (#50449153)
That's okay. Wasn't the Graphing Calculator essentially that as well?
Re:Apple has new Mac app coming to make running local AI mod... by II2II on Wednesday November 11, 2026 @02:34AM (#50450703)
This is the story I read many years back:

https://www.pacifict.com/Story/

If true, it is an astounding story. That said, I'm happy to see that Apple ships a graphing calculator with macOS 27 (albeit, a different one). I may not use it much these days, but I have fond memories of it when I was in university.

Re:Apple has new Mac app coming to make running local AI mod... by apparent on Tuesday November 10, 2026 @07:48PM (#50448433)
This is what I've wanted for the last few years. I have played around with local models and had some success, but I don't want to deal with the hassle of setting up, updating, etc.

If all of this were easy, I would happily invest in new dedicated hardware to run it. This could be a full-blown Mac or it could be a souped up HomePod-type device, loaded with RAM. Better yet, make it a revitalized Matter-enabled Airport!

Re:Apple has new Mac app coming to make running local AI mod... by LeBit on Wednesday November 11, 2026 @01:41AM (#50450362)
MacMini with M7 Pro and 96G of RAM.

They are going to sell sure 10,000$ and you won’t need anything else for the rest of your life (if you are over 90).

Btw, llama.cpp with llama-swap ain’t that hard to configure if you have access to a potential LLM and have 5h of your life available to that task.

Re:Apple has new Mac app coming to make running local AI mod... by apparent on Wednesday November 11, 2026 @02:56AM (#50450814)
Yeah, I might dive in with llama.cpp at some point, but unless Apple censors the models I can choose I'd just as soon go with Apple's solution.

I also want something that integrates super easily with my iPhone and other devices, and hopefully Apple will make it possible to use my server as an intermediate fallback between my iPhone and their cloud models.

Re:Apple has new Mac app coming to make running local AI mod... by D13Fd on Tuesday November 10, 2026 @07:58PM (#50448488)
What would make running local models easy is being able to buy a Mac Studio without a 6-month delay :-(
Re:Apple has new Mac app coming to make running local AI mod... by quaddoggy on Tuesday November 10, 2026 @08:24PM (#50448709)
After I think about it, this makes sense that Claris would tackle such a project under the auspices of Apple. They're a subsidiary so they can monkey around with this stuff without having to adhere to the draconian everyday operating restrictions of "Apple proper". Good on them if they can pivot into something that hews to AI.
Re:Apple has new Mac app coming to make running local AI mod... by nxobject on Wednesday November 11, 2026 @05:09AM (#50451636)
It's fun to think about Claris as the hobby "well, we'll see if it works out I guess, but no worries if not" brand.
Re:Apple has new Mac app coming to make running local AI mod... by nier on Wednesday November 11, 2026 @12:29AM (#50450021)
(1) All the headaches of maintaining FileMaker Server on Apple hardware, (2) multiplied with the additional requirement to cluster devices, (3) but without users accustomed to the silliness of misusing consumer devices running a consumer operating system for a service that must be reliable, and (4) an Apple subsidiary unable to bring about meaningful change.
Re:Apple has new Mac app coming to make running local AI mod... by brainless on Wednesday November 11, 2026 @01:48AM (#50450397)
I really do not understand the value of running large models locally. I am absolutely fond of local models but for specific tasks. The agents need to do a lot of work in this case: orchestration, big or small model split of planning and work, split into small tasks, merging, etc.

LLMs with <30B parameter models seem like the sweet spot. I would rather focus on multiple tiny LLMs that are tuned to specific tasks (SQL queries, finance/accounting, backend/frontend dev, etc.).

For larger models, a $10-40 ish Neuralwatt/Opencode Go or any similar subscription goes so far for the average user that it is ridiculous. We are still in the "youth" era of agents. There are many patterns that work well with smaller LLMs. Or with a big-small LLM combination.

My context:

I own the tiny 16GB M4 Mac Mini and I use LLMs (coding agents) to build software and a few of my products use LLMs directly. Full-time user of LLMs, do not read or write code manually. I run the tiny Qwen series (<10B params) sometimes but a couple $20 subscriptions (Claude, Neuralwatt) take care of my full-time agent usage.

Re:Apple has new Mac app coming to make running local AI mod... by tokioyoyo on Wednesday November 11, 2026 @01:55AM (#50450442)
Model/harness that runs locally, which you can connect from your phone to do non-dev queries (looking stuff up, recommendations, planning and etc.) can save ~$300/year on various subscriptions.
Re:Apple has new Mac app coming to make running local AI mod... by brainless on Wednesday November 11, 2026 @02:05AM (#50450501)
Agreed but I feel we will see even cheaper annual or prepaid options. Say, a $20 upfront and get the cheapest inference, comparable to Sonnet with subscription. For a personal assistant that can run on laptop and phone, these will be mainstream. $20 may last a couple months for vast majority of users.
Re:Apple has new Mac app coming to make running local AI mod... by rapsey on Wednesday November 11, 2026 @01:57AM (#50450453)
The addressable market is enthusiasts. The cheapest and least loyal consumer that exists. But I guess it is just a small side project for apple which is fine.
Re:Apple has new Mac app coming to make running local AI mod... by conductr on Wednesday November 11, 2026 @02:28AM (#50450658)
Idk. Once they say our AI app is facilitating AI needs of big number of DAUs, the stock price will likely go up even if there’s no revenue path. It’s a pretty tulip.
Re:Apple has new Mac app coming to make running local AI mod... by jmaker on Wednesday November 11, 2026 @03:03AM (#50450853)
When I hear Apple and AI, I think of Siri. And then of my attempts to use it in my smart home where it would turn off all smart sockets instead of turning on the lights in one room. Or its response latency. Or how I was excited about Apple Intelligence and then removed it completely and am hesitant to upgrade to OS 27.

I understand that we’re talking about local inference with an Apple inference engine for Apple Silicon uniform memory. And I know it’s a stretch of an analogy. But somehow I’ve grown skeptical of Apple’s AI capabilities. Not to say Microsoft’s or Google’s weren’t disappointing.

Re:Apple has new Mac app coming to make running local AI mod... by conductr on Wednesday November 11, 2026 @10:57AM (#50454899)
For me Siri hasn’t improved a bit since release and it’s just the fact that she can’t understand my voice/words. Constantly mishears or asks me to repeat things. I have a pretty “regular” or “generic” US English accent and other voice agents have no problem so it’s definitely Siri. So I have never really been able to ascertain if it’s any good without an acceptable interface. All to say, the spirit of your analogy seems appropriate to me.
Re:Apple has new Mac app coming to make running local AI mod... by ThePinion on Wednesday November 11, 2026 @02:02AM (#50450486)
I have the same Mac M4 16gb. Do you have the Qwen model assist the larger models for menial tasks/tool calls during coding it can handle? As in have them work in tandem to save on tokens/calls on the large models or are your local agents just meant for their own specific side tasks?
Re:Apple has new Mac app coming to make running local AI mod... by brainless on Wednesday November 11, 2026 @02:10AM (#50450536)
A mix of both. I have been experimenting building agents that focus on small/tiny LLMs. For example, I built a web-app prototyping harness which used Qwen 4/9B models but separate agents (tool calls, prompts and actual code to parse) for CSS management, TSX management, Router, state, etc. It used SolidJS only.

There was a task manager which was given context of the tech stack so it could split the incoming requests. Then branch out the tasks to appropriate agents. Combine the generated code - this was a file/module/import manager.

The other way is let tiny models (again I would use agents for different use cases) do the busy work - tool calling, finding evidence, etc. I usually setup agents to re-write tool call history and create fresh API requests without using multi-turn chat with tool call history.

Re:Apple has new Mac app coming to make running local AI mod... by ThePinion on Wednesday November 11, 2026 @02:56PM (#50457812)
I really appreciate the response, that gives me good ideas on where to start going about all this. It seems so silly to have API models doing so much file exploration and tool calling.

I saw this a while ago which shows small models and focuses on the ones that make the least (or no) wrong tool calls and it got me intrigued on the possibilities in this realm, especially for lower end devices. https://github.com/MikeVeerman/tool-calling-benchmark

Re:Apple has new Mac app coming to make running local AI mod... by phyzix5761 on Wednesday November 11, 2026 @02:27AM (#50450649)
Privacy is a big reason to want to run model locally
Re:Apple has new Mac app coming to make running local AI mod... by brainless on Wednesday November 11, 2026 @02:31AM (#50450684)
True that. But ZDR is also not that expensive. Although for many businesses, buying a Mac with tons of memory is not expensive. Running a dedicated agent on top of private data is certainly valuable.
Re:Apple has new Mac app coming to make running local AI mod... by bauruine on Wednesday November 11, 2026 @03:14AM (#50450898)
ZDR is just a "bug" or "rogue AI agent" away from being all data retention. ZDR is not for privacy but for corporations that need to check a compliance box so they can blame someone else.
Re:Apple has new Mac app coming to make running local AI mod... by nolist_policy on Wednesday November 11, 2026 @03:44AM (#50451056)
Openrouter now does CSAM scanning and retention on so called "Zero Data Retention" requests.

https://openrouter.ai/blog/announcements/csam-screening/

Re:Apple has new Mac app coming to make running local AI mod... by Hamuko on Wednesday November 11, 2026 @02:43AM (#50450756)
[delayed]
Re:Apple has new Mac app coming to make running local AI mod... by WokeUp420 on Wednesday November 11, 2026 @02:39AM (#50450733)
It's called privacy
Re:Apple has new Mac app coming to make running local AI mod... by olowe on Wednesday November 11, 2026 @03:25AM (#50450942)
I can imagine a future where we look back at these times of relying on big opaque hosted services to run inference and find it quaint. Perhaps the same way nowadays we find it quaint that you couldn't always just compile software on a fanless portable computer.

How far away that is, or whether it will ever happen, I don't know. I agree though that the tooling is still so young it's hard to say what shape this type of computing will look like and therefore what kinds of resources will be in-demand.

Same context as yourself. I run 8 - 12Bish models locally on a 24GB M4 Macbook Air and also have a couple subscriptions (OpenCode Go, Mistral Pro) for access to DeepSeek etc. to power through yucky big bloated codebases at work.

Re:Apple has new Mac app coming to make running local AI mod... by yieldcrv on Wednesday November 11, 2026 @04:13AM (#50451222)
subagents use mostly the same allocation of memory, so you can do orchestration and planning easily with many subagents just like you do with Claude Code with anthropic's cloud models

Pi has a subagents package to enable in its harness

Re:Apple has new Mac app coming to make running local AI mod... by sleight42 on Wednesday November 11, 2026 @01:50AM (#50450407)
An Apple M5 Ultra running an app like that? Because Apple hardware is a monolith, unlike the PC space, "Harbor" will be configured out of the box with the ideal settings for many well-known open-weight models.

... Looks like I picked the wrong week to buy parts for a linux-based inference box.

Re:Apple has new Mac app coming to make running local AI mod... by wewewedxfgdf on Wednesday November 11, 2026 @01:55AM (#50450436)
AMD needs Apple to kick it in the pants and make it realise they need to ACTUALLY compete instead of trying to just copy Nvidia.
Re:Apple has new Mac app coming to make running local AI mod... by ggcr on Wednesday November 11, 2026 @02:02AM (#50450482)
So many projects, start-ups and frameworks called Harbor already
Re:Apple has new Mac app coming to make running local AI mod... by sgt on Wednesday November 11, 2026 @08:53AM (#50453439)
Indeed, but practically you can just take any name unless any of the existing projects are seriously big.
Re:Apple has new Mac app coming to make running local AI mod... by jph on Wednesday November 11, 2026 @02:10AM (#50450531)
If you ask who would pay for Apple local models, I would.

A Mac Studio high end is $30k one-time versus my current run rate of $10k/week for Claude Code (if I paid API rates rather than Ultra plan). he comparison is a general ballpark not an exact equivalent.

I currently run 128GB with qwen3.8:27b-mlx. It hits the heat limit of the Mac when working on a medium-size codebase for test-driven compliance such as security auditing, that need to deeply evaluate the whole codebase.

Re:Apple has new Mac app coming to make running local AI mod... by larodi on Wednesday November 11, 2026 @02:20AM (#50450592)
> if I paid API rates rather than Ultra plan

yes, but you pay the Ultra plan, that's the whole point, isn't it? Let's be honest also - qwen3.8:27b-mlx is nowhere near Sonnet, both in size and cap, and if you do $10k a week of usage, you should know that.

Re:Apple has new Mac app coming to make running local AI mod... by dgacmu on Wednesday November 11, 2026 @10:28AM (#50454565)
The 512GB server he specified would be running something more like qwen3.8-flash-next, which is probably competitive with sonnet 5 (but still loses to 5.5).

I've tried it out on a 512GB dram server with 2*3090s and it works really quite well. Draws enough power to cost something similar to Luna, though.

Re:Apple has new Mac app coming to make running local AI mod... by larodi on Wednesday November 11, 2026 @04:25PM (#50458903)
Still u can never beat the cost of electricity unless saturated with batches inference, speculative decode, maybe beam search and what not.
Re:Apple has new Mac app coming to make running local AI mod... by dgacmu on Wednesday November 11, 2026 @08:39PM (#50461897)
Not really. My setup is just a hair cheaper than paying API prices for Luna (and it will do security audits for me). The mac would be even better on power.

I don't think any of these self hosted setups are a good deal when you look at the NPV of the capex plus the power costs, but if you already own the hardware it can be okay or even a slight cost savings.

Re:Apple has new Mac app coming to make running local AI mod... by zaphirplane on Wednesday November 11, 2026 @02:22AM (#50450612)
[delayed]
Re:Apple has new Mac app coming to make running local AI mod... by jph on Wednesday November 11, 2026 @03:55AM (#50451118)
Break even is likely for API pricing. For example one of the projects is a web app that's processing user input, making AI suggestions, generating reports, doing ongoing observability, and running batch processing overnight.

Claude currently does these via API pricing, not Claude Ultra personal.

Re:Apple has new Mac app coming to make running local AI mod... by jmaker on Wednesday November 11, 2026 @03:10AM (#50450883)
$10k for Sonnet per week? How did you arrive at that number? It’s quite a huge inference volume. No consumer hardware will give you that level of latency at comparable cost.

$6k is not the only cost - electricity adds up over time. And hardware can fail, redundancy is priced into the token prices and subscription plans. Maintenance is mostly negligible, but some updates/upgrades might regress. There’s a lot to SRE to keep it running at that scale.

Re:Apple has new Mac app coming to make running local AI mod... by jph on Wednesday November 11, 2026 @03:48AM (#50451085)
> How did you arrive at that number?

I run "npx ccusage@latest weekly" and also spot-check Claude Code sessions via "/usage".

> No consumer hardware will give you that level of latency at comparable cost.

You're right. My belief is the frontier AI companies are currently subsidizing real costs for the purpose of rapid growth customer sign ups, and that in a couple years or so local costs will become reasonable, at least for full-throttle work that's queueable.

Re:Apple has new Mac app coming to make running local AI mod... by adi_kurian on Wednesday November 11, 2026 @02:51PM (#50457739)
I did the math once, to run Kimi K3 on a Mac, you'd need to daisy chain 5 Mac Studio M3 Ultras. So $125K. And the latency would be bad.

For good latency, you would need a multi GPU server around $3-600K.

I agree the hardware will catch up and local is the future. For the average person who is sharing there privacy data out willy nilly all the time without much regard, i.e. most people, it makes no sense right now to go local vs. API / subscription given the price differential.

Re:Apple has new Mac app coming to make running local AI mod... by no-name-here on Sunday November 15, 2026 @03:09AM (#50505030)
> no sense right now

Local hw may get cheaper in the future, but so will dc hw, and DCs still have the advantage of 24x7 use, more efficient DC transformers, etc

Re:Apple has new Mac app coming to make running local AI mod... by adi_kurian on Monday November 16, 2026 @06:35PM (#50525167)
Unless the grid goes down, my computer can turn on and is on 24x7.

And I don't need to be connected to the internet to use a local model.

I'm looking at the rate at which the models continue to improve and the pricing / rate limits in the the OpenAI/Codex/Claude/Grok subscriptions.

Local makes sense only when the rate of improvement flattens and the pricing goes way up.

I'd bet that at least the latter is going to happen, soon.

Re:Apple has new Mac app coming to make running local AI mod... by no-name-here on Tuesday November 17, 2026 @01:42AM (#50528200)
>> DCs still have the advantage of 24x7 use, more efficient DC transformers

> my computer can turn on and is on 24x7.

1. Unless you are running AI queries 24x7 to max out your hardware, a piece of hardware that is idle the majority of the time (even if you had a full-time jobs that used the card 100% literally every single second of your workday, that would still be less than 1/3 utilized) is going to necessarily have way worse $ cost for you than cloud.

2. An idle PC does not use anywhere near the same power as inference running 100%, so I'm unsure why mention that your PC is on 24x7 - does that change things?

3. But even if we ignore both of the above and you had 4 or 5 40-hour per-week jobs that utilized local hardware ~100% every second, it would still be worse in terms of electricity costs, etc. than cloud due to worse AC/DC transformers for a local machine than a datacenter.

> I'm looking at the rate at which the models continue to improve and the pricing / rate limits in the the OpenAI/Codex/Claude/Grok subscriptions.

4. Last year you could have made the case that open models were cheaper, but now it's the frontier labs that are often the cheapest on the cost/task pareto curve.

> … the pricing goes way up. I'd bet that at least the latter is going to happen, soon.

5. Even if we were only comparing open cloud models vs frontier cloud models, is your argument that frontier labs will stop trying to be competitive with the open models?

6. When comparing to local, an obvious alternative would be cloud-hosted open models available from large numbers of providers already - why would their pricing go way up?

Re:Apple has new Mac app coming to make running local AI mod... by zamadatix on Wednesday November 11, 2026 @08:53PM (#50462016)
Even if one believes the price of models will only go up from frontier AI companies AND believe the local AI frontier will be fast enough at a good enough profile, it still doesn't explain how you're going to beat the price of a place hosting open weight models at scale on shared hardware always maxed out 100% in a place with cheap electricity by buying a single platform up front for 3 years.

Data sovereignty always makes sense in this case because it's explicitly not about cost, but I've not seen a convincing "it's actually cheaper to do it yourself" analysis that came to that conclusion by answering all of these things up front instead of just hoping it'll somehow get better by then.

Re:Apple has new Mac app coming to make running local AI mod... by jann on Wednesday November 11, 2026 @10:15AM (#50454423)
To be fair, having multiple Claude subscriptions is also against the ToS afaik, so you’d have a much higher run rate.
Re:Apple has new Mac app coming to make running local AI mod... by jph on Wednesday November 11, 2026 @04:31PM (#50458984)
Anthropic tells me I can have two Ultra subscriptions. FWIW I'm doing open source.
Re:Apple has new Mac app coming to make running local AI mod... by larodi on Friday November 13, 2026 @06:04AM (#50481779)
I can easily see everyone on my team having a Claude subscription, and then we can orchestrate and federate to spend the unused limits. I don’t see how this breaks toc, given we don’t resell. And 1000€ (or dollars) in Anthropic subscription buys billions if not trillions of tokens, if used right.
Re:Apple has new Mac app coming to make running local AI mod... by larodi on Friday November 13, 2026 @06:02AM (#50481753)
Why is it that you don’t include costs for the engineer catering to 512gigs system, potentially well saturated in usage? Anyone who understands inference at this level is at least 5k a month.
Re:Apple has new Mac app coming to make running local AI mod... by throwaway_new_1 on Wednesday November 11, 2026 @02:56AM (#50450811)
The Mac Pro was discontinued at the wrong time. Or maybe just introduced at the wrong time.
Re:Apple has new Mac app coming to make running local AI mod... by pavlov on Wednesday November 11, 2026 @03:02AM (#50450846)
The Mac Studio is inheritor of the 2013 Mac Pro approach. Back then people still needed internal expansion slots, so it was just too early.
Re:Apple has new Mac app coming to make running local AI mod... by andy_ppp on Wednesday November 11, 2026 @05:26AM (#50451766)
I would be quite happy with an external box with no processor, no ports etc. (potentially HDMI out), just the GPU cores and plenty of memory. Then I can upgrade AI without the rest of the machine.

Of course Apple will not offer this.

Re:Apple has new Mac app coming to make running local AI mod... by rcarmo on Wednesday November 11, 2026 @03:31AM (#50450985)
Sherlocking Exo, then--although that will work in a regular LAN as well. I should have finished https://rcarmo.github.io/projects/go-exotic...
Re:Apple has new Mac app coming to make running local AI mod... by pentakkusu on Wednesday November 11, 2026 @03:37AM (#50451024)
As a recent M6 Mac mini owner, HELL TO THE YEAHHH BABYYYYYYY

I use oMLX btw, on 32GB URAM, running Hermes with Qwen 3.6 @ 128k context window.

I realize I am a smalltimer but for general day to day sensitive agentic stuff, this is the entry point.

Re:Apple has new Mac app coming to make running local AI mod... by yieldcrv on Wednesday November 11, 2026 @04:11AM (#50451213)
if you're running qwen, check out what happens when you swap oMLX for kapitsa

its built just for qwen, healthy competition on tokens/sec

Re:Apple has new Mac app coming to make running local AI mod... by Maxion on Wednesday November 11, 2026 @05:36AM (#50451832)
What is the experience of these local LLM models on this type of hardware? what are they capable of ? what do you use them for?
Re:Apple has new Mac app coming to make running local AI mod... by pentakkusu on Wednesday November 11, 2026 @06:53AM (#50452331)
A-OK, I would say. The pinnacle would be that I managed to develop a purpose made android app for my 2016 Honda dash unit with Hermes.

Hermes runs my personal to-do, manages 2 calendars, triages forwarded bills via it's own email address, orchestrates my docker container fleet. It also tends to a partly botched llm-wiki, that is built on Obsidian.

Re:Apple has new Mac app coming to make running local AI mod... by yieldcrv on Wednesday November 11, 2026 @01:33PM (#50456799)
I do agentic coding and agentic search and document analysis just like what I do with Claude

they have 128k - 256k context windows now, subagents use the same weights loaded in memory so you have spawn many subagents at the same time just like Claude Code, and the tokens/sec has is like 150-200

I just do different projects based on its complexity or liability or its moat

Re:Apple has new Mac app coming to make running local AI mod... by pentakkusu on Wednesday November 11, 2026 @06:49AM (#50452303)
never heard of it, will check!
Re:Apple has new Mac app coming to make running local AI mod... by jwr on Wednesday November 11, 2026 @03:51AM (#50451098)
I've been running local models under ollama, then lm-studio, and now mtplx (command-line, from supervisord). I'd welcome a vendor-supported solution, if it doesn't turn into bloatware (like lm-studio did).
Re:Apple has new Mac app coming to make running local AI mod... by nxobject on Wednesday November 11, 2026 @04:06AM (#50451178)
Developers! Developers! Developers! Developers!
Re:Apple has new Mac app coming to make running local AI mod... by thibsrn on Wednesday November 11, 2026 @04:16AM (#50451240)
I have been using llama.app, which is the desktop interface built on top of llama.cpp by the same people. It is an alternative to Ollama that might interest people who want to switch given Ollama's reputation and previous decisions. Llama.app has a really clean design, an elegant and intuitive interface. But it's good to get alternatives as well, if Apple also gets into the game.

https://llama.app/

Re:Apple has new Mac app coming to make running local AI mod... by hypfer on Wednesday November 11, 2026 @06:50AM (#50452316)
I've instinctively downvoted, wrongly assuming that this is just someone shilling their own equally bad stuff, but the repo is https://github.com/ggml-org/Llama-macOS

Note that it is under the ggml-org. So that's at least not a third-party taking advantage of llama.cpp

With the clean landing page URLs, you just don't know. So GitHub is probably the best source to link

Re:Apple has new Mac app coming to make running local AI mod... by thibsrn on Wednesday November 11, 2026 @07:44AM (#50452743)
[delayed]
Re:Apple has new Mac app coming to make running local AI mod... by jameshart on Wednesday November 11, 2026 @07:48AM (#50452782)
Llama.cpp is MIT licensed open source software - it’s intended for third parties to take advantage of it.
Re:Apple has new Mac app coming to make running local AI mod... by hypfer on Wednesday November 11, 2026 @07:58AM (#50452859)
This is just ragebait no one should interact with beside flagging.
Re:Apple has new Mac app coming to make running local AI mod... by HelloUsername on Wednesday November 11, 2026 @10:10AM (#50454362)
> With https://llama.app, you just don't know. So GitHub is probably the best source to link

You can always check here on HN as well to get a sense of its authenticity: https://news.ycombinator.com/item?id=49267928

Re:Apple has new Mac app coming to make running local AI mod... by Espressosaurus on Wednesday November 11, 2026 @10:06AM (#50454321)
llama.app has a lot of similar problems that ollama has, but at least you can use the hugging face downloader with it.

That you can't configure the models independently is a glaring oversight. The alt-space to enter the chat window (at least on Windows) is awful and with no way to disable it I've resorted to just using the app as an easier interface to their downloader.

It does have a nice, clean UI and it doesn't hide the models behind some opaque identifier.

Re:Apple has new Mac app coming to make running local AI mod... by crossroadsguy on Wednesday November 11, 2026 @04:40AM (#50451424)
[delayed]
Re:Apple has new Mac app coming to make running local AI mod... by Insanity on Wednesday November 11, 2026 @04:58AM (#50451568)
“Extremely easy today” - to who?

Their customer base includes many non-tech people who don’t want open a terminal window or even know of what a “GitHub” is. And they probably would not trust it as much as an app build by Apple.

I agree it’s easy to run locally (although I do so on Linux), but what’s easy for the HN bubble and easy for the rest of population is not the same.

Re:Apple has new Mac app coming to make running local AI mod... by amelius on Wednesday November 11, 2026 @05:11AM (#50451648)
Great, except with current DRAM prices nobody can afford it.
Re:Apple has new Mac app coming to make running local AI mod... by rickdg on Wednesday November 11, 2026 @05:11AM (#50451652)
MacOS is a bad server.
Re:Apple has new Mac app coming to make running local AI mod... by gehsty on Wednesday November 11, 2026 @05:14AM (#50451688)
As models improve and hardware becomes more capable Apple are definitely well positioned.

I am super interested to see what the Apple silicon team can deliver when their full attention is turned to local LLM acceleration.

Re:Apple has new Mac app coming to make running local AI mod... by alex43578 on Wednesday November 11, 2026 @05:30AM (#50451791)
I don't see any evidence that local models (able to run on truly consumer hardware, not a DGX or multiple GPUs) will close the capability gap in a meaningful way. I have powerful hardware (multiple $K in today's prices), and only recently has Qwen Next come even close to being "useful", rather than a curiosity.

But the problem is a $20 ChatGPT/Claude subscription utterly trounces it in usability, user experience, and performance. By the time we get Opus 5.5 at home, we'll be on like Opus 7 or 8, and I'd bet Sonnet 7 or 8 will dust whatever can be run on the base MacBook of that time. It's fine if people think local 5.5 will be good enough, but it just seems like as AI keeps getting better, you'd want to use the better tooling - nobody has decided a 2010 MacBook was good enough when the M1 came out.

Re:Apple has new Mac app coming to make running local AI mod... by willis936 on Wednesday November 11, 2026 @05:37AM (#50451837)
The up and to the right trend faced issues with the end of Dennard scaling. The only way it continues is with irresponsible allocation of more natural resources to compute. I'd prefer my atoms not be turned into paperclips.
Re:Apple has new Mac app coming to make running local AI mod... by EagnaIonat on Wednesday November 11, 2026 @05:40AM (#50451850)
> will close the capability gap in a meaningful way.

I ran OpenClaw in a VM on my mac a few months back, only using local models. It was painfully slow (no MLX) but what it created was on-par with Claude at that time too.

The models are certainly powerful enough, but the frontier models are more than just an LLM model in the back.

Re:Apple has new Mac app coming to make running local AI mod... by SeanDav on Wednesday November 11, 2026 @06:07AM (#50452012)
2 things:

- As AI continues to improve, the gains will become increasingly incremental. This means that your local model will be almost identical in performance as the latest cloud version, for all but edge case problems.

- If your local model is good enough for your current needs, the only tokens you are chewing through ae utility costs and asset depreciation. Relatively cheap. It is easy to overrun even 200 /month cloud models for serious AI use.

Re:Apple has new Mac app coming to make running local AI mod... by ben_w on Wednesday November 11, 2026 @06:30AM (#50452169)
> - As AI continues to improve, the gains will become increasingly incremental. This means that your local model will be almost identical in performance as the latest cloud version, for all but edge case problems.

How much is "good enough" depends what we want it for.

Right now, the vision which was presented as a joke in (AFAICT more than one project all called) vibeOS seems like it could be viable with better local inference… but that likely needs a few more 9s of reliability even relative to current SOTA models, and we might even never get there if smaller local models always produce code which big hosted models can find vulnerabilities in.

Same if you want home inference to replace hiring a professional lawyer, architect, tutor, etc.: even though the AI has been getting passing grades in the law and medical exams since the early days, whoever gives out public liability insurance probably want to see more 9s of reliability before giving the OK.

Re:Apple has new Mac app coming to make running local AI mod... by radlad on Wednesday November 11, 2026 @09:43AM (#50454059)
> It is easy to overrun even 200 /month cloud models for serious AI use.

Not with the tok/s I get.

Re:Apple has new Mac app coming to make running local AI mod... by cribbles on Wednesday November 11, 2026 @06:15AM (#50452062)
I agree with you, fwiw, but Apple's own consumer hardcore is not the choice of metaphor I would go with here - the M1 MacBook Pro and the group of iPhones that came out around the same time were the exact moment when Apple devices hit a "good enough" asymptote for many people (myself included)
Re:Apple has new Mac app coming to make running local AI mod... by xdertz on Wednesday November 11, 2026 @08:04AM (#50452931)
If you are comparing pure quality sure but don't forget quantity. It is very easy to blow through a weekly quota in one day. Fully local means you have unlimited usage which is something no provider gives you on a subscription.

When comparing API prices and privacy concerns, local might win.

Re:Apple has new Mac app coming to make running local AI mod... by bearjaws on Wednesday November 11, 2026 @08:11AM (#50452999)
> Fully local means you have unlimited usage

20tk/s is not unlimited when you have a lifespan that isn't infinite.

Re:Apple has new Mac app coming to make running local AI mod... by mycall on Wednesday November 11, 2026 @08:56AM (#50453484)
> Claude subscription

Not good for PII/PPI

Re:Apple has new Mac app coming to make running local AI mod... by gehsty on Wednesday November 11, 2026 @09:05AM (#50453591)
The tension over local / remote is a tale as old as time in computing, when the technology settles down both will continue to exist with different use cases…

in 5yrs time running an M12 with a Bionic LLM Engine (or whatever they call it) may be good enough for a very very good AI experience. Enterprise / professionals will likely still pay for frontier models.

Re:Apple has new Mac app coming to make running local AI mod... by Rover222 on Wednesday November 11, 2026 @11:30AM (#50455290)
Yeah I think it’s peak nerd bubble to think local models are going to wipe out the value prop of Anthropic.
Re:Apple has new Mac app coming to make running local AI mod... by mrtksn on Wednesday November 11, 2026 @05:41AM (#50451857)
Sure, Apple has an opportunity here but I have no confidence that they won't screw it up.

For starters, they need to let me get rid of their AI stuff and free up the space. Apple aggressively pushing their AI down the throat of their users means that they suck at it but trying to make it happen using their muscles in other areas.

Just like people figured out how to make their Android TV not suck, it suggests that some time it the future people can make their OS not suck and this will make macOS irrelevant if Apple doesn't fix it first. Unfortunately for Apple, they operate in a system where they must keep growing their numbers.

Such a great company, its a shame that they couldn't figure out this AI stuff. Fingers crossed that this tool actually fixes that by just giving ap and let people do whatever they want to do as efficiently as they can on the brilliant hardware Apple creates.

Re:Apple has new Mac app coming to make running local AI mod... by ethbr1 on Wednesday November 11, 2026 @06:53AM (#50452333)
I'd add to this that Apple's ability to support a third-party ecosystem with stable development interfaces to their hardware has been at best "mixed" over the years.

Especially in the modern era, the firmware/software side of macOS definitely doesn't seem like a priority.

Re:Apple has new Mac app coming to make running local AI mod... by mark_l_watson on Wednesday November 11, 2026 @09:48AM (#50454127)
Their hardware is especially good for MOE models, less suitable for dense. I use Laguna XS 2.1 6bit and Qwen-3.8-next-flash 2.6bit most because they are MOEs and run efficiently. I love Qwen-3.7:27B but as a dense model I only use it in “run something and walk away” use cases: slow.
Re:Apple has new Mac app coming to make running local AI mod... by wingi on Wednesday November 11, 2026 @05:18AM (#50451722)
what is the difference to ollama, lama.cpp ... ?
Re:Apple has new Mac app coming to make running local AI mod... by _pdp_ on Wednesday November 11, 2026 @05:57AM (#50451956)
That will be really cool. It is already possible though through Apple Intelligence. There is an open source app that already leverages that.

https://github.com/pdparchitect/noodle

Re:Apple has new Mac app coming to make running local AI mod... by DerDerDaIst on Wednesday November 11, 2026 @07:19AM (#50452571)
they should add a sandbox for the agentic part as well.

so you can control and monitor what the whole setup is doing inside and outside the box.

Re:Apple has new Mac app coming to make running local AI mod... by KolibriFly on Wednesday November 11, 2026 @07:24AM (#50452602)
Calculate the total cost of two new Mac Studios with max memory and cables. For that budget you could burn tokens on cloud APIs for a long time or build a dedicated server on open hardware with clear server buses
Re:Apple has new Mac app coming to make running local AI mod... by DerDerDaIst on Wednesday November 11, 2026 @07:29AM (#50452644)
devise the cost by the burnrate with cloud ai and you know when you'll break even. Add a bonus for the privacy.

Another bonus: Here in Germany a huge chunk of the hardware cost can be deducted from the tax bill.

Re:Apple has new Mac app coming to make running local AI mod... by _1 on Wednesday November 11, 2026 @07:29AM (#50452651)
Two new Mac Studios come with privacy.
Re:Apple has new Mac app coming to make running local AI mod... by hello5010 on Wednesday November 11, 2026 @07:32AM (#50452666)
> For that budget you could burn tokens on cloud APIs for a long time or build a dedicated server on open hardware with clear server buses

Let the market decide.

Seems like enterprises and individual users are slowly switching to local models.

Sucks to be Member of Technical staff at OAI/ANT.

Re:Apple has new Mac app coming to make running local AI mod... by bel8 on Wednesday November 11, 2026 @08:54AM (#50453455)
> Seems like both enterprises and individual users are switching to local models.

I know a total of zero and individuals or companies using local inference for their workhorse inference.

Local models are just not up to most tasks for now at least.

Re:Apple has new Mac app coming to make running local AI mod... by CharlieDigital on Wednesday November 11, 2026 @11:41AM (#50455426)
I take poster's usage of "local" to mean "self-hosted" which would include Revolut switching to self hosted GLM (which I think we'll see more of)
Re:Apple has new Mac app coming to make running local AI mod... by tencentshill on Wednesday November 11, 2026 @09:15AM (#50453696)
Do you think the cost of cloud tokens will stay the same or go down over the next ~5 years? Not likely, especially as the big ones start IPOs.
Re:Apple has new Mac app coming to make running local AI mod... by no-name-here on Sunday November 15, 2026 @03:38AM (#50505152)
> next ~5 years

Haven’t token prices been falling by like 75% per year? I guess you’re saying that after IPO they will stop trying to be competitive with all the cloud providers that host open models?

Re:Apple has new Mac app coming to make running local AI mod... by justauserid on Thursday November 12, 2026 @12:48AM (#50463536)
There are two use cases where this is useful:

1. privacy (w.r.t. personal data, human agency, IP, whatever) – this is absolutely is the most crucial.

2. if the needs are absolutely sufficed with local model(s) runnable on a super-expensive mac with a whole lot of RAM and the equivalent cost on API/subscription would be at least few times (say 2-3x) considering machine repair/maintainence/etc

There's a 3rd case thoguh – the hobbylist case, which, imho and in my anecdotal evidence, is the majority of local-model-chasing outside of enterprise (which is usually not hobbyist to begin with).

So there of couse are three legit use-cases.

Re:Apple has new Mac app coming to make running local AI mod... by azuanrb on Wednesday November 11, 2026 @07:43AM (#50452738)
All this talk about Apple being the long-term winner in AI is putting an awful lot of faith in Apple. Siri is still about 1/10th as useful as ChatGPT on a good day.

It’s the “year of the Linux desktop” meme all over again. Any day now.

- From a happy iPhone Duo user

Re:Apple has new Mac app coming to make running local AI mod... by api on Wednesday November 11, 2026 @08:07AM (#50452956)
What I’d like Apple Intelligence to be is this plus a good local app to chat with models plus an iCloud version of OpenRouter with privacy screening features.

Even better would be a peer to peer model hosting hardware pooling system but that’s probably too much to ask and would expose Apple to liability issues in some jurisdictions.

Re:Apple has new Mac app coming to make running local AI mod... by iantpe on Wednesday November 11, 2026 @08:39AM (#50453287)
What I need most right now is a model like TypeSafe's Jev that can be built directly into the computer.

Jev allows for numerous small judgments: Is this email important? Which program should handle this request? Is this operation risky? There's no need for large LLMs to slowly generate long paragraphs of text; all you need is a fast, structured result that returns the message.

Having a local Jev-like model in the operating system for quick decision-making, and then calling the larger model when deeper thinking is needed, would be very useful.

Re:Apple has new Mac app coming to make running local AI mod... by madebywelch on Wednesday November 11, 2026 @08:42AM (#50453317)
I'm using Ollama https://ollama.com/library/kev for this now.
Re:Apple has new Mac app coming to make running local AI mod... by satvikpendem on Wednesday November 11, 2026 @01:46PM (#50456948)
Not recommended to use Ollama, I like Unsloth.

https://sleepingrobots.com/dreams/stop-using-ollama/

Re:Apple has new Mac app coming to make running local AI mod... by 233mhz on Wednesday November 11, 2026 @10:23AM (#50454510)
> There's no need for large LLMs

Do you know how big jev is? Decision models are small but the "smart" (aka useable) ones aren't that small.

Re:Apple has new Mac app coming to make running local AI mod... by hhh on Wednesday November 11, 2026 @12:15PM (#50455851)
I think ~30b params
Re:Apple has new Mac app coming to make running local AI mod... by illwrks on Wednesday November 11, 2026 @10:23AM (#50454511)
In a way you want something like blackberry messenger, a centralised hub for all app messages, notices etc, and then JEV hooked into it as a traffic controller of sorts. I wonder if there’s anything like that, perhaps on Linux?
Re:Apple has new Mac app coming to make running local AI mod... by CharlieDigital on Wednesday November 11, 2026 @11:34AM (#50455346)
They are even small enough to run in browsers: https://openjev.com/
Re:Apple has new Mac app coming to make running local AI mod... by boogieknite on Wednesday November 11, 2026 @12:04PM (#50455706)
https://github.com/TheoLeeCJ/SemIf-OpenJev

dabbling with it in browsers but i expect it would answer the mail for you, if you find it accurate enough

Re:Apple has new Mac app coming to make running local AI mod... by mark_l_watson on Wednesday November 11, 2026 @09:41AM (#50454024)
I am on the waiting list. I have a new 64G mac mini and an older 32G model. The directions for setting up a distributed inference system aren’t too gnarly but I haven’t bothered. I will when I get access to Harbor.

I think it is a great joy to run most things locally, and still occasionally use the best commercial models when local will not cut it.

Re:Apple has new Mac app coming to make running local AI mod... by lenerdenator on Wednesday November 11, 2026 @09:50AM (#50454150)
I'd absolutely use this; doubly so if there was a way to route traffic from your iPhone to it through iCloud. That might even get me to buy a second Mac just for server use.
Re:Apple has new Mac app coming to make running local AI mod... by nkotov on Wednesday November 11, 2026 @10:22AM (#50454503)
I built out Infinity (https://infinitychat.app) for myself which does something similar. One click to download and run, compare models etc.
Re:Apple has new Mac app coming to make running local AI mod... by joenot443 on Wednesday November 11, 2026 @10:32AM (#50454613)
This is an awesome looking landing page. Very aesthetic with lots of immediate examples of what it does.
Re:Apple has new Mac app coming to make running local AI mod... by ontouchstart on Wednesday November 11, 2026 @10:44AM (#50454752)
I am already doing 100% offline inferences and AI assisted coding with bespoke software developed with local models.

In my case it reached the recursive self improvement stage a few weeks ago. It feels like the early days of personal computing in the era of DOS and Apple II.

The hardware is already there. The only limit is product imagination.

Re:Apple has new Mac app coming to make running local AI mod... by ConfusedDog on Wednesday November 11, 2026 @10:48AM (#50454796)
Any blog post or information on how your setup looks like?
Re:Apple has new Mac app coming to make running local AI mod... by fridder on Wednesday November 11, 2026 @10:49AM (#50454812)
It will be interesting to see how this compares to things like oMLX
Re:Apple has new Mac app coming to make running local AI mod... by caycep on Wednesday November 11, 2026 @07:27PM (#50461138)
Also I keep forgetting about Claris; I'm kind of sentimental about it and I hope maybe this gives them a shot in the arm.
Re:Apple has new Mac app coming to make running local AI mod... by dwaite on Thursday November 12, 2026 @11:39AM (#50470124)
By "Apple" they mean "Claris", a wholly owned subsidiary which was formerly Filemaker, Inc.

So this is interesting, but it will likely be an independent product rather than part of the core operating system.

Re:Apple has new Mac app coming to make running local AI mod... by avazhi on Thursday November 12, 2026 @04:42PM (#50474718)
Can I natively remove AI bloatware and models from running on my Mac in Golden Gate yet?
Re:Apple has new Mac app coming to make running local AI mod... by ourcat on Friday November 13, 2026 @01:07PM (#50487360)
Hopefully, one of those local models will be their own. The one that they're currently forcing people to download. 10Gb of stuff that they absolutely might not want.
Re:Apple has new Mac app coming to make running local AI mod... by glassresearch on Friday November 13, 2026 @02:18PM (#50488381)
I am not encouraged by Apple's forays thus far into local models.