Factoring in the increased cost of memory, Apple's threatened service revenue and the stagnation of ecosystem products like the Mac and iPad, I think they have a really challenging future to navigate. The whole "sell people a B2C ecosystem" business model is more threatened than ever.
Capability is one thing but a focus on the actual product, as an teleological destination that is built rather than something cobbled together as a solution to a problem about how to sell what you have generally has taken them the right way.
It's nice to have these types of niches when they make you money. But the Mac isn't profitable like the iPhone is, and probably makes less money than the iPad does if you count aftermarket service sales. The further Apple drifts from their roots as a computer manufacturer, the more the Mac starts to look like a liability to them.
Apple's Last Stand is their prosumer segment, and once that's gone I don't think their vertical integration playbook gets them anywhere further. Their bottom line is dependent on finding new ways to make B2C profitable, which has resulted in subscription services like AppleTV/Apple Music/iCloud so far.
That looks pretty healthy to me.
Note that because most enterprise software is now web based ( ie moved to the data centre as you have pointed out ) - a lot of the corporate Windows only lockin has gone - so I'm seeing a steady rise in Macs in business.
What's not healthy is the desktop market ( apple laptops outsell desktops like 10:1 ) - but that's whiles that's more marked in the Apple space, it's largely an overall market trend. ( Overall desktops are about 20% of total shipments ).
So Apple will only be in trouble in this space if the laptop ceases to become wanted - and that's all about the interface - some apps are better with keyboard and mouse/trackpad and a bigger screen. If all that goes away and we just talk to our computers then I'd argue that Apple are better placed than Lenovo to weather that one.
The proliferation of web-based enterprise software mostly stands to Windows and ChromeOS' advantage. macOS is the platform that has relied on "native" and "ecosystem" efforts that are becoming increasingly unpopular among consumers and industry pundits that don't like paying per-seat for software services. The Mac Pro used for render farms, on-prem hosting and cluster computing was depreciated completely, driving some of Apple's highest-margin customers over to Linux and Windows servers. Apple has absolutely began their Mac pivot to prosumer/B2C vending, and it's resulted in advertisements and SaaS slop invading macOS.
Lenovo will keep selling laptops because that's their product equivalent to the iPhone. Apple's equivalent to the iPhone is... well, the iPhone. If they see an opportunity to force Mac users into an iPad-esque experience, they'll take it in a heartbeat and play coy asking "what's a computer?" like the iPad advertisements. The Mac not an important product for Apple these days, the App Store is.
Totally agree that Mac servers ( they went years ago ) and Mac desktops ( and desktops in general ) are on decline.
I just think you are basing your opinion on the past. Sure in the past, when Apple hardware was worse overall than the Wintel offering, Apple heavily relied on the Mac specific software, and your right that's less important now more than ever.
But the point here is right now, and for the last few years, Apple hardware is significantly better! And because of this in turns your argument on it's head.
I think we both agree that the landscape in terms of mix of devices may change in the future - I just think Apple is following that market, not 'forcing' Mac users into an iPad-esque experience.
And right now I think the laptop market is still pretty healthy - I can't see Apple moving away from it unless sales drop, and as I said sales are rising.
What I meant by "Apple's Last Stand" was referring to the Mac. Their destiny is to become "the iPhone company", and their inability to support the Mac as a competitive product has basically guaranteed that fate. The landscape of computing already changed, and when Apple was confronted with the opportunity to invest in GPGPU products, Vulkan or PCIe hardware support, they forced those customers to pound sand. That is not an optimistic outlook for their future ambitions, at least from where I'm standing. The "my way or the highway" philosophy is hemorrhaging market share.
The data says the opposite.
In the only non-phone markets that matter - laptops and tablets - Apple is doing very well - and as I said, in the laptop market it is growing market share.
It's fine not to like Apple, Apple products or the choices they have made - but you need to ground your arguments on the facts. Yep you might not be their target customer - and they may have lost you - but overall their laptop market share is growing.
I don’t think there will be a choice long-term for Apple the conditions of the market have changed, and you have to change with it or get left by the wayside. They have shown that they will adapt and they certainly haven’t wasted money like their tech competition over the years.
Apple would make more money investing in a CUDA-style architecture than they would by becoming a subsistance manufacturer for the pitiful margins of the iPhone, iPad and Mac. They are a moneymaking company, a fact often lost on the masses that
You tell me.
Right now 128GB MacBook is the top of the line and you could do Qwen 3.8 Flash or similar.
There is a rumor that the M7 chip can use 1.5TB of memory which would imply Apple is aiming for more memory on devices.[1]
Would that imply the entry-level MacBook will have 128GB and top of the line models could run larger reasoning models? Then the question is price and if any of this will translate to iPhone for on-phone models.
With how expensive memory is, IDK if they can pull this off but I hope they do
[1] https://www.tomshardware.com/tech-industry/semiconductors/ap...
Even so, DDR5 is so high-demand that it's likely that Apple can't outbid customers like Nvidia or OpenAI when they drive the margins they do.
SK hynix, Samsung and Micron are all eager to squeeze Apple for the market price of DDR5. They won't build extra fab capacity for them because Nvidia, AMD and OpenAI will outbid them for future capacity. Products like HBM are overbooked right now too, which means that building an extra DDR5 facility might just end up feeding the enterprise HBM market.
And CXMT has refused Apple's business entirely: https://appleinsider.com/articles/26/08/06/chinese-ram-suppl...
If Apple, in 2030 has a compute product that a worker can BYO(X) to work that has 2TB RAM, with an encrypted personalized context that can float between agents, then they will be in a very interesting place.
holy shit
And with a device like this, you pay one single time to buy the product and then never have to think about paying for tokens ever again. For ordinary users that's silly, but for users or businesses chewing through lots of tokens, this means they can create their own turnkey replacement for "the cloud" where the only cost after purchasing the machine is the electricity to run it (which with these machines is very little). Mix that with the privacy benefits and suddenly it makes a lot of sense.
Like I said, seems HPC is lost art. All four sub replies missed that in my original comment.
I agree with you, and i would like to set up a server at work for local inference but we simply do not have the knowledge, it's much easier to get a couple of AI Max machines that are good enough for me and the boss which i convinced on the good points on running clankers locally and be done with it (though my plan is to use the AI MAX machines to figure out what the infrastructure and workflow will look like, and at some point ask for the investment)
damn, too bad that the laptops with the 470 are capped at 64GB
How is this literally even possible in 2026? In a thread about LLMs, no less?
Then there's testing the approaches and see whatever sticks best.
Not saying they're right.
For individuals though, it’s the same reason plenty of people pay for the 2tb or 4tb SSD for their laptops or desktops even though NAS has been a thing for 40 years. Maintaining a “server” of any sort is a completely separate endeavor for most. Just like a NAS is a no-brainer for many and non-starter for many more.
The problem with LLMs outside of server is that people typically have many devices. So you can run LLM on your laptop. You want to make a query from your phone. Start your laptop? You want to do something from your smart home? Start your laptop? What about your partner? Will they need to buy another top of the line laptop for themselves? Your kids?
Alternative to server is of course that everything will have over 100 GB of memory, eat battery like crazy, be dumber and slower than single server in your household.
4 TB ssd was like $300 until recently. Even if RAM prices were to go to previous values, I don't think AI capability will be any comparable. Besides you also need proper compute, unless you want your prefill to be snail slow.
Every scenario you described applies the same to a NAS. What if you need a file from your phone? Open your laptop? What if your partner needs a file? Open your laptop? The answer to all of them is either yes, or they have it on their laptop/phone too.
Apple (and other laptop makers) weren’t charging $300 for 4tb even before the shortage. They realized that not everyone needed that and they way overcharged for that but still less than today’s prices. People who needed it bought it even though it would have been a lot cheaper for them to build a NAS. A current-gen M5 is perfectly capable of doing decent tk/s given enough RAM. In 2 or 3 years it would be even more capable, it just needs RAM.
Plenty of people will use clou hosted models like they do with storage today. Plenty of people will build home servers for AI. Just like plenty of people have home NASs. But the number of people who just want a large SSD on their laptop make the previous group a rounding error and those people would rather have a beefy laptop or desktop with enough RAM in it. If anyone can solve the Phone<->Desktop communication seamlessly it’s Apple after all.
Unlike storage however, a lot of people are now aware of how much data collection tech and AI companies are doing and the idea that AI models are training on their personal photos and prompts is deeply unappealing to many. With just storage, what could Google or Apple do? Certainly they wouldn’t just print your photos and put them in an ad or on their website. But with AI models, it’s a different equation
No. Files are your property. Inference is a service.
There's also the fact that working with files over network is often ill-advised and borderline impossible for some workloads. Even when that NAS is connected over wire and not wireless. Meanwhile even if you're on so-so connection, LLMs work great.
NAS is mostly good for backups, torrenting linux isos and serving them with Plex or Jellyfin. You are not installing software on your NAS instead of your machine. Or doing video editing. Or playing demanding games. I have file server at home and I still have ~8 TB of storage in my desktop, of which at leat 3 TB I can't move out.
B. If I have 1 TB of my work files, my wife has 1 TB of her work files, that's 2 TB of total storage. If both us need LLM, it doesn't mean we need twice the LLM as one of us.
But on the other side, equipping data centers was never Apples main business. Their approach to markets is to design products for the individuals. They also usually have very long time plans. Look at where the Apple Silicon today is and how long a path it took. What about the day, where at least a medium sized Mac becomes a great platform for running large models locally? Very easy to use, no setup, no privacy concerns. Also never worry about "tokens". You can then use AI as you use other local resources of the hardware you own today.
But the family shouldn’t be limited by that. We’re not going to see M6 Max hardware, because the M7 line is being fast-tracked and pulled forward. And I wouldn’t be at all surprised to see M7 capable of 1-2TB or more.
Spoiler alert: they're supply-constrained too. If they could make more money by shaking Apple down for binned memory chips, you can bet your bottom dollar that they would.
Apple is just butthurt that they can't afford the street price for DDR5. Their computers are chopped liver.
Probably sitting under a router, so that it can hand off bigger jobs to an Apple DC somewhere, probably with a certain number of credits based on your iCloud sub.
I don’t think Apple can be in a position where all of the Chinese device-making companies can get memory at a significantly cheaper price from CMXT, and Apple is stuck with buying memory from the three hyenas of memory at a significantly higher price.
That’s not going to help Apple sell their devices at a competitive price worldwide over time against the Chinese computer makers (Lenovo, Asus, and Motorola) and make no mistake about it: their share of the market worldwide will get bigger because of this change in the memory market; their focus will be on the long term, while the lawyers/MBA/finance types in the West will have their heads stuck in the short term.
It’s the (Chinese companies’) opportunity, and they’re not going to let it pass; I wouldn’t. In addition, Apple is in competition with Nvidia, Microsoft, Intel, AMD, Qualcomm, Google, Meta, and indirectly with Anthropic and OpenAI (whose CEO, Sam Altman, recently declared that computer ram is wasted on low-level regular computer users), along with a whole legion of other 3D model makers on the procurement of memory.
The combination of all these elements going into the future means that if Apple wants to stay ahead, I believe Apple has no choice but to take memory in house, they have the design and engineering capability in-house, and they have the money because they didn’t burn it on AI models and data centers.
This scenario is no different than replacing Intel or Qualcomm; you can see the writing/destination and the ultimate train wreck up ahead if Apple doesn’t roll up its sleeves and get busy, the market has changed and again Apple has to change and adapt to the new conditions.
Why are you talking about memory? Nobody cares about memory. You know what people care about? People care about ballrooms, and you know what, the US has the best!
People who know ballrooms say the US is hot right now, hotter than anywhere else in the world, because we're building the best ballroom in the world. Can you imagine that? China is nowhere on ballrooms.
I wouldn't be surprised if that was happening already -- they plan five years ahead, after all, and they've been slowly taking other systems in-house (e.g. baseband/modem) already.
Most people neither need nor want to run large LLMs locally.
The entry level MacBook Neo costs $599. Even if RAM prices revert to the pre-AI mean, the entry level models are not going to be that stacked with RAM.
Eventually we'll get to a doubling where entry level means 16GB of RAM, but most people won't be running anything more than simple models for light local work.
Have you ever tried running large LLMs on a MacBook Pro? It's hot, loud, and makes your battery level disappear at rates you didn't know were possible if you're not plugged in. It's a very niche hobby.
I'm old enough to remember the time when most people neither needed nor wanted a phone with a large screen and no buttons
Personally, I find the whole idea of AI porn pretty depressing. Porn is very bad acting, or no acting, but at least the people are real.
First someone would need to invest and train a model on pr0n, and then they'd likely first want to recoup that money - perhaps by selling a subscription to pr0n addicts.
Whatever local LLM device comes out of this, it certainly won't be a laptop.
(I envision a black box like a router you plug into a socket and let sit in a corner of some room.)
You can get uncensored versions, but they are less usable (lobotomized).
i suspect that they will at least do offloading for casual usage as well. if they can ship 24GB in a homeview or appletv style product, it's game over.
why would a company who locks iPad Pro entry level literally out of ram that exists on its own chips.
I get their high end 10k-20k laptops will be able to reach these specs and gatekept behind also upgrading the cpu to the ultra but no way will it be an option in entry level.
Where I am, it's cheaper to purchase multiple claude subscriptions than it is for the power bill from running a local model. Factor in the hardware costs, and you're looking at a break even a decade in the future. Yes, there's privacy, etc, but now you're down into fractions of a percent of users.
If you are an investor, you should remember they are a fashion product more than a tech company.
If you are a user, you should remember they are a fashion company more than a tech company.
It's not comparable to huge models of course, but given the power/size ratio here it shows that serious gains are on the table for models that can run fast on a high-end laptop.
A few years back we never thought open source llm would get as good and even the small and cheap model
Its good to have a race and such competition
At some point, the real cost of inference/intelligence is going to come due, and the existing open source models will be good enough for 95% of tasks users want (or training their own model(s) will be inexpensive for Apple).
Apple will be there, as usual, to provide secure, on-device, faster inference that the vast majority of their customers will be fine with. Let everyone incur the R&D costs.
Look at what it costs to serve Kimi K3.1 Pro on a B300. It suggests margins of 98-99% at API prices for OpenAI and Anthropic.
Yes, I promise you, there are many, many people who are hesitant to build anything real on the assumption that either Anthropic or OpenAI will continue maintaining their services as they are today in perpetuity.
I agree that it pays to be wary of the additional abstraction layers they offer that purport to make your life easier, but for anything running standard completion calls or the like, I don’t see why this needs to be a concern.
I don't think so. LLM inference enjoys huge economies of scale. At no point in the foreseeable future will a local model be able to compete with a cloud model in terms of price. Local models will have the privacy angle, but very few people will be willing to pay top dollar for that. There will be some people, for sure, but the vast majority will just use cloud models.
Maybe when chip would infer at 10-20x the speed of a 5090 RTX, otherwise it's really..bad.
Beside the 35b, the others are too slow to do anything vs cloud models, unless you have a local B200+. And the Qwen 35b has the reasoning capacity of a 2yo doing maths.
I wasn't "impressed" with any models for coding until 1year ago, only then they started to be "usuable" with the fault that we know and still exists.
What new bike should I get? How should I rephrase this email? What to do about my persistent headaches? Recipes based on these ingredients?
It'll become easier and more affordable to distill/train/optimize smaller local models to meet your specific work needs. Multi-agent efforts will orchestrate the balance between using on-prem hardware for most tasks, and then defer to cloud models for more demanding/edge-case tasks. Especially if an organization can manage what data is shared with which model.
I also expect cloud providers to eventually start charging different rates for on-peak and off-peak usage, which would incentivize running what you can with the local compute you have otherwise sitting idle across dozens to hundreds of machines in your fleet.
I could be wrong and all your future hardware purchases will be glorified thin clients, with less local processing capabilities than today's laptops, servers, and towers.
In the mainframe's heyday, it was difficult to grasp a world in which compute became so dense and so cheap that it made sense for each individual to have all processing and memory on their desk, talk less of on their lap and in their hand.
Of course this time could be different. But, when we look at previous relentless progress in compute and efficiency, then also couple that with the breakthroughs AI itself unlocks, it's hard for me to imagine that centralized AI will meet both the scale and flexibility desired for all use cases.
Just as centralized compute never fully disappeared -- it took the form of client-server computing and the cloud, there's no question that centralized inference will continue to exist.
But it wouldn't surprise me if, ten years from now, 90% of global inference happens at the client.
While simultaneously, the 10% of inference that takes place in the datacenter is wildly lucrative and orders of magnitude greater than today.
Put simply: the inference pie may become so large that both client and datacenter win.
Beyond inference, even local HPC or large in-memory workloads. Steve Jobs dreamed that the NeXT Computer could be used to cure cancer in a dorm room (whatever tha tmeans), and I guess a bunch of Mac Studios chained together wouldn't be bad for a lot of computationally tough biomedical "basic science" applications.
Qwen flash-next is at least as good as Sonnet for my uses, and the speed is perfectly acceptable.
I really think the big labs are going to soon start feeling pricing pressure for everything smaller than Opus-tier models, and it will come for those next.
Only if you're comparing apples with oranges. There are no local LLMs at 128GB RAM which compete with Sonnet 5.5 intelligence. And the gap is a chasm when comparing against Opus 5.5, which is fast and cheap and plentiful on event he $20 subscription.
People saying this actually know how to run local models.
People claiming otherwise are Claude customers who know nothing beyond its point-and-click interface.
Consider that fact.
Does it actually? Sure, it is operating at huge scale and this design choice allows enormous models (presumably enormous MoE models). But is it achieving economies of scale?
Economies of scale are rooted more in the idea of a profitable thing becoming cheaper as the market grows, allowing cheaper manufacturing and further growing the market.
The big two or three LLMs are cheap because they are substantially subsidised by investor cash, and they are not profitable at all in any sustainable sense: the current pricing can only be sustained for as long as they can raise money, and the market will (and does!) shrink when it is asked to pay a less-subsidised price.
There appears to me to be no route to true profitability for this design strategy at all. Even the open weights router companies are downstream of largesse from state-affiliated companies.
No, it's exactly the opposite.
The big money is in small(ish) but finely tuned for specific tasks models.
Whoever invents an app store for LoRA adapters will win this AI race.
Apple and Microsoft and other companies will own that front-end experience with the customer, and it’s not going to matter to most customers whose backend gets used for what.
And Apple really wants to sell people who have no cred in the space their stuff because THEY have no cred in the space.
Its basically a club for stupid f**s
It's not as if they are short of money.
Or are you saying that Apple should become a memory manufacturer, rather than working with TSMC?
I'm not sure which chip it'll be, but I now for sure I'm not buying new devices until the AI boom has somewhat settled and we kinda understand what we'll be using it for. Until then, every manufacturer will just be guessing what device to build and will be outdated within a few months.
Could be the winner, in your opinion. They are extremely well positioned with hardware, devices, ecosystem, privacy, brand value & trust, and a significant active base. So far, they have not yet delivered on any useful AI application. There are so many opportunities in both MacOS and iOS, I guess they just need a new software VP.
So does Apple even need to create applications (that nowadays will get copied and opensourced in a day), or the hardware is the winning strategy in the end?
I think the more interesting question for Apple is the split between cloud and local. Economies of scale and aggregation vs privacy and ownership. I’d say so far it’s 2-1.
Who has? Google, Anthropic, OpenAI and Microsoft have spent hundreds of billions and produced nothing but chat apps that Apple could build in a few days, they’re all just interfaces to models that are available to Apple via an API. Hard to imagine Apple as anything but the winner of this era unless OpenAI or Anthropic pull something out of the bag.
You could spend it on free universal healthcare.
> they are being inactive because they don't have the skillsets
Rare to see an argument that Apple can't hire talent.
They need a significant team creating their own model, (the talent of which has already gone elsewhere) and they also need to be working towards the future of photonic computing for running those models with success long term, again which will require a huge hiring effort. Considering it's clear they are not putting in that hiring effort it's obvious what work they have been doing.
This is extremely revisionist. For ex with WiFi, ThinkPad + a Lucent WiFi card was standard issue for years before any Apple product had WiFi. Apple shipped integrated WiFi, which is wholly consistent with the notion of improving what the industry is doing.
Connectors? Yes, Apple has a history of improving connectors. Other computers have had connectors since forever. In this case, Firewire was Apple's semi-proprietary alternative to USB. USB, which Apple put into their computers years after others had shipped it.
> They need a significant team creating their own model
Your judgement. It's entirely reasonable at this point to license other models and look for a better/cheaper entry point. Apple tends to enter markets when it is possible to make profit. It is not clear yet that the business of creating and running advanced models is a profitable venture. By which I mean no company has yet demonstrated the ability to earn a positive ROI by developing and running an advanced model.
> working towards the future of photonic computing
Again, nothing in Apple's history would suggest that they would even aim to do this.
None of that stuff has worked right for several years now apart from maybe Gmail.
This isn’t true they’ve literally launched Apple Intelligence with multiple apps and surfaces three times now and it’s flopped each time so badly they regroup and pretend it wasn’t the real launch then launch it again at the next WWDC.
Siri just got AI-fied and it's worse and slower than ChatGPT in 2022. Also it doesn't work offline anymore.
I used to "describe a shortcut" maybe 5 times this week and today I was hit with "you reached the limit". Mind you I have a 17 Pro and spend $120/year on iCloud.
These are useful applications of AI - or would be if they actually worked.
But this is all based on marketing not facts. Apple is as privacy invasive as the next guy. Obviously this shtick will work as long as marketing continues do to good job.
Anthropic and OpenAI want to exit because they know they have no moat... and personally, I believe that the sociopaths running the US at the moment want to provoke a great economic crash. The Evangelical ones because they want the armageddon [1], the rich fucks because they took the "you shall own nothing" part for real and want to be the new neo-feudal overlords. And the best way to achieve that is by tying everyone's retirement savings up into their bubbly assets and then crashing down the economy, leading them to buy up everyone's asset at fire-sale prices with the liquid cash they made during the exit.
[1] https://www.theguardian.com/world/2023/oct/30/us-evangelical...
Soon enough: "Claude, please build me a MacOS clone. Hell, copy the entire Apple ecosystem the way I want it."
Also a lot of people work from laptops and running inference on data centres for 10th of the price is a no-brainer. Local models are more of a niche and always will be.
Not if they can't sell anything because of ridiculous DRAM prices.
Apple, to me, is the winner in the end of this AI chapter.
I might be one of only few people who think Apple is a loser in the AI chapter.I don't think it shows yet but I think the dominance of the App Store will end. I think a ton of iOS apps will be replaced by ChatGPT/Claude. I think there is a big opening for a company to redesign the phone from the ground up purely around an AI assistant instead of apps.
I think AI will severely weaken iOS, App Store, and the iPhone in the next few years.
Not to mention higher chip prices will eat into hardware margins.
Sure, but I don't think it's usually the apps that people pay much money for. And on top of that, app store revenue is (from a rough estimation) 6-7% of total revenue (although it's high-margin). Apple would be entirely fine.
And if you're right that the phone of the future will be reimagined as centred around being an AI assistant: innovative device design, user experience, hiding technology, integrating software/hardware/cloud are all things that Apple is historically pretty good at (with hiccups and bad periods for sure, but other companies certainly aren't better in general).
~15-20% of Apple's total profits at ~75% margin.
Investors are not going to like if that suddenly starts shrinking.
An LLM can probably whip up a music player app, but won't have the licenses to provide you the music.
An LLM can probably whip up someone akin to a free and single player Genshin Impact, but the whales want attention from other players.
An LLM can probably whip up some sort of SFTP from phone <-> Desktop for pseudo-cloud storage, but you still need to provide disk space
Why? Off the top of my mind (far from an expert and not thinking about it very hard), they can profit from AI in the following ways that have nothing at all to do with the app store:
- selling the best devices for local AI (which they kind of are with apple silicon and mac minis)
- selling devices (mostly phones probably) with excellent AI integration that are superior to the competition (remains to be seen, but that's the sort of thing that Apple tends to be better at than the competition)
- selling AI-powered services (not super convinced, I don't think Apple is excellent at services)
For example if they capture 10% more of the global phone market because iPhones became that much better than alternatives thanks to AI integrations, that'd probably offset decline in app store revenue.Just throwing random ideas and numbers here, just making the point that shifting environment can weaken a revenue stream while strengthening (or enabling) others
To put it in perspective they reportedly collected about $675 million from OpenAI in fees last year, that's equivalent to about $1.5 billion revenue in hardware sales and TBD for AI services but certainly over $1 billion.
https://www.macrumors.com/2026/03/20/apple-made-nearly-900m-...
The other avenue that AI is hitting their services revenue is the Google Search deal, it's a revenue sharing agreement and AI is eroding that revenue on Google's side.
all things that Apple is historically pretty good at
But do they have a better, more efficient, smarter AI model? Can they keep up with Anthropic and OpenAI's models?Not to mention, Apple is going to want to not disrupt itself so they're going to deliberately slow down which opens up the opportunity for someone else.
Therefore, I don't think they will be able to compete well in the new world.
OpenAI, Anthropic, and others can spend billions on the infrastructure to train the models at a time when the technology is still immature and largely inefficient and then Apple can simply license the models as needed, giving the user the choice while potentially protecting their privacy. Once there's relative maturity in the industry, they can either continue to license the models, distill their own from them, or even train their own using others' infrastructure. To me, it's a smarter long term strategy even if it temporarily gives up their control of key technology.
Personally, it seems to be the smarter play and aligned with how Apple usually does things. They're usually not first to market but they're first to introduce a refined product that make people forget about everything that came before it.
I get what Apple is trying to do. But it will still open them up to massive disruption and potential new entrants into mobile devices.
Why this question? I don't think that the way that anyone expects Apple to profit off AI is from selling models
This is what we all want, this is what kicked off the open web back when the internet first started. This is what made everybody excited for user agents. Now we have user agents once more and we are getting excited about the new agentic web, but temper your expectations. This time, rent-seeking corporations are in it from the start, see the exact same promises that excited you about the open web, and plan to take full advantage right away. This is why everyone is trying to sell their own agent instead of giving access to your own.
Is this master stroke in the room with us now?
Now it can at maximum profit from it going public but not even that is sure now.
Literally nobody in the world wants more AI slop in their lives.
This is coming from my own experience as a software developer. I do not want to leave Claude Code. I'm hooking up everything into Claude Code and have it do what I want for me. I do not want to log into my cloud provider. I do not want to log into my Github. I don't want to log into any 3rd party services. I just want to stay in Claude Code.
I think developers tend to be ahead of the general public by 1-2 years in AI use. I imagine a future where most people simply want to stay within their ChatGPT/Claude/Muse/Grok/Gemini agent to do just about everything.
If my prediction is correct, I think Apple is going to be in trouble because it weakens the iPhone ecosystem severely and they are so far behind in AI everything that it's hard for me to see them ever catching up. Not to mention they do not have access to compute since they've not invested in compute.
I'm pushing the perennial 'developers (and engineers) think differently' trope here, but I think you're wildly optimistic.
The inability of the average person to write a detailed enough spec for implementation, compared to how trivial it is for an experienced developer, is mind boggling.
Imho, this is going to extend to agentic interactions with app-as-service-for-agent.
You don't magically increase customer experience by multiplying (garbage average user prompt) * (whatever agent they use) * (MCP, etc).
The first two variables are too unbounded.
I meant that non-developers will also find that staying within their AI agent to do what they want is better than downloading, logging in, learning different app UIs.
In our company, we recently gave Claude subscriptions to all office workers. They all hooked it up to their favorite tools already and they've been raving about it. It was a revelation for them.
LLMs are getting exceptionally good at interpreting vague asks.
One of the biggest issues I've seen in this kind of environment is that there are 50 dashboards, created by different people, and the data presented on them hasn't been validated to ensure that the data is correct and pulling from the same location. It's not clear that the data can be trusted and it's not clear what the authoritative source of truth is.
IE. They know what they're looking for. They know when the data is right or wrong because they've seen it from other places here and there over time.
When they're not sure and the risk of getting it wrong is costly, they'll find the data analyst to verify.
I've seen it firsthand, multiple time and while anecdotes aren't data, conversations I've had with peers at other companies suggest they have similar experiences.
Furthermore, that persona is also often incapable of self-checking and recognizing errors in their presented data, because they don't know how it was generated in the first place.
In the past, you could look at a web page, see some structure, understand process, etc. and intuitively see and understand what you're suppose to do. When you remove all of that in favor of a text box, you spend a lot of time asking questions and prompting to get information or accomplish tasks that would otherwise have taken a minute or two and when you're done, you still don't understand how the underlying system, process, or policy is and how it works.
It's competition.
Apple's use of Siri in Vision Pro is a good start, but there would need to be tighter integration w/ the UI. That's probably on the roadmap... assuming they continue to develop it.
Instagram, Tiktok, Youtube, you're right. So hopefully OpenAI can convince those companies to convert their apps over. Wouldn't be too hard given how easy it is to duplicate an app nowadays.
How much longer do you give until Claude Code replaces you entirely? Product or CEO dictate their wishes and Claude returns a freshly compiled binary and offers to deploy it to production with a simple "yes".
How much longer do you give until Claude Code replaces you entirely?
Probably not for a few more years I'm guessing.That's why my investment strategy is centered around AI replacing me and making me unemployable.
I'll definitely be buying Anthropic.
Funny enough, I do have substantial amount of Apple stocks I accumulated pre-ChatGPT but I've been selling here and there as it reaches all time highs due it being an "AI hedge".
I think Wallstreet is getting it wrong and I think the narrative around Apple will change fast in the next few months.
Failing to evaluate AI beyond "slop" is down to a lack of imagination.
[1] https://www.pewresearch.org/short-reads/2026/03/12/key-findi...
'Agent - file my tax return'.
In order to do that it's going to require you to have set up access to allow your bank accounts, shares holdings etc. etc.
Would you want to set that up to allow per task or simply always be in the background so if somebody hijacked your agent it could drain your funds?
Essentially every single non-builtin app on my phone fundamentally requires the internet to work, and is backed by some sort of SaaS with a proprietary API. And even if/when the APIs are open, no normal person is going to decide they want to somehow use YouTube or Tiktok or Feeld or Spotify by talking to ChatGPT.
Spotify is an interesting one. I could see myself wanting to control Spotify with my AI agent.
It only needs to be created once. You don't want a different UI every time you listen to something.
And that's the issue, each app maker will simply integrate AI themselves with their proprietary API rather than allowing ChatGPT to take their lunch.
IE. I want to stay inside ChatGPT/Claude.
I think Spotify will open up. Or some AI-native music service will be started to compete and fill the demand.
Only if structurally it makes sense. There's demand for many many things on this planet without a business model that would satisfy that demand.
overestimating (based on one datapoint?) the number of
people who want to use their devices from within an LLM
chat app,
I don't know about that. "Apps" were a step forward in many ways, but when spending time with older and/or non-technical users they are pretty overwhelmed by the sheer number of apps.I think they would really like to have one unified, plain-language interface.
Nice username btw.
They learn these apps differently than "we" do.
They (again, particularly older users who didn't grow up with GUIs) don't understand GUI paradigms, so they compensate by memorizing... even a small change to their memorized flow is highly disruptive because they cannot reason about how to get back onto the happy path.
(It's like the old, pre-GPS-navigation days when you went on a road trip with a stack of printed out directions from MapQuest. It was great, until you missed a turn and had no idea how to get back on track...)
If Spotify won't do it, then maybe Apple Music might. Youtube Music might. Tidal might. Deezer might. Or a new service might.
It all depends on market share. If Amazon thinks they'll make more money letting ChatGPT/Grok/Gemini/Muse to shop, they will. I think they will personally.
I've played around a lot with using my own AI to generate music recommendations and build playlists.
> I don't want to use Spotify's AI. I want to use my own AI, who knows me more
It's pretty tough to beat what Spotify (or Apple, or whatever your platform is) knows about you w.r.t. listening habits and preferences. My successful experiments have involved exporting Spotify / Apple Music data into sqlite and a skill that tells my agent how to query this data.
It works pretty well! Still, I'd say it's only roughly on parity with the AI stuff Spotify is working on. The main benefit to rolling my own is being sure (at least, for now) that the recommendations aren't being corrupted by sponsored placement which I'm sure is Spotify's end goal.
I have no real point to this point, just blabbering. Have you cooked up any good solutions via rolling your own?
I can imagine trying 'I want to hear a techno song that goes umm tss umm tss at 140bpm" and it finds a few million.
In what way? To find recommendations? Or search for a particular track?
If a new mobile device form-factor proves to be usable, they'll come out with one eventually like they always do- like the iPhone duo being years and years behind?
When the bubble pops they could still snap up an AI lab on the cheap later.
They wanted to keep everyone on their proprietary platform instead of enabling their devices to be used on the wider internet / being a more open mobile platform.
As long as apple allows some AI integration, then I think they'll be fine- and in fact I trust their privacy and security model more than if I bought a Google device. (not to say I trust anyone's security model, but it's clear that Apple has a more vested interest in security and privacy than Google does)
It'll make the iPhone look like Blackberry.
And let's say that Apple wants to respond with their own AI-first phone. But wait, they don't have the model. They don't have the compute. Most of their employees only know the old way of doing things.
Just simply because interfaces need to be crafted, and they're a design language that you learn over time. And most likely everyone needs the same things 90% of the time anyways.
When I step into my car I don't need the heating button to move closer if it's cold. I just want to learn where it is once and use it when I need to for x number of months / time of day.
That also goes for things like films and music - most of the time we actually want to be seeing and hearing the same things as everyone else (for some different definitions of "everyone"), not something that's made for us.
Generating a UI to solve a specific problem of yours is just an example.
I can't be the only one who has ever used an app and thought, man I wish they added this or moved the button to this, or fixed this stupid UI bug.
It was fun as a toy (you could customize your UI theme to anything), but not useful as an actual user interface because it was inconsistent. Sometimes you'd get a progress bar, sometimes a percentage, sometimes a table of sub-tasks and their current status, etc.
They’ll be fine
We've already seen several attempts to make devices purely around assistants like Humane Pin or Rabbit. In 99% of cases users need a reliable screen with clear buttons not a conversational barrier between them and action
That's why I've been trying to do everything in Claude Code.
I don't know, I think there's 1 or 2 apps I might like that for, but for many, I think I'd run into trade offs I didn't expec and at a certain point I feel like I'd end up feeling like 'I wish someone would just do this for me'.
If the models would tell me no sometimes, I could see this working, but opinionated models would need to 'mesh' with your opinions right? So then we'd end up where software is now, just choosing the model we prefer, instead of the specific app. And then there will be times my preferred model isn't the right model for 'this' application, so now I'm juggling multiple model apps, and what did we solve exactly?
I personally didn't like the voice-approach of Humane Pin. Rabbit R1 was more interesting but execution was poor, screen was not big enough, models weren't smart enough, apps and services weren't as open via MCP as they are now and in the future.
I want to see a company like OpenAI or a very well funded veteran company give it a try.
To get something like this: https://www.youtube.com/watch?v=b9hxwgH2tN0
I think folks who live in spec-driven worlds just don’t appreciate how poorly understood the capabilities and processes of computing and networks are, to the point where even if you gave people hallucination free LLMs you’d probably find people just frustrating themselves because they can’t figure out what they want, what it should do, and how it should be used.
Quite apart from the huge chunk of the app ecosystem that relies on common protocols, centralised services and so on.
people don’t know what they want, and when they do know they can’t explain it.
* Book me an uber in 15 minutes.* Based on our music discussions, make a playlist for me in Spotify. No songs older than 15 years.
* Look through my email, find all my receipts, show me a graph of my spend and categorize them.
* My business needs warehouse space. Find warehouse services within 15 miles of San Francisco. Ask them for their pricing and capacity.
* Find a hotel for me in Los Angeles on October 1st to Oct 5th. 4 starts. Max $200/night. Gym is a must. Don't care about pool. Close to airport. I have Platinum membership with Accor so try to find Accor hotels but not a must.
People do know what they want.
It is easy to express yes, but is this how people think about what they want to listen to?
Someone can already do this in a chat bot, see the list of things and then find it on Spotify or whatever their favorite music service is.
That’s a surprising requirement. Is it a proxy for “less likely that I’ve already heard it”? For “the band probably still tours”? For “I can discuss it with friends without sounding like I’ve been living in a cave”?
I have seen this with yet "AI-unexperienced" users - for simple questions or textreformating, they are absolutely fine with the Chatbots. But thats all they can get out of it: Above that level their experience is very often frustrating due to too less understanding while having high expectancy towards the model in reverse (like "its AI so it should know...")
And this people end up then not using any of the AI tools beyond that because they do not "believe" / trust that this thingy can get work done.
Please.
I want to see the projected numbers.
What about doing something like REA on a whole app store collection, rewriting the app's reversed description set into code according the new devices' requirements? Perhaps we can't see the future as there are so many variations yet imagined.
For instance; I don't think LLMs will be replacing Spotify, Facebook, Insta, or Youtube for my parents. They absolutely do not want to purely interact with a blackbox. They want to scroll through songs/shows/etc. they want to tap on it, and have the app do the thing.
Even as a SWE, I have absolutely zero desire to interact with an LLM for everything, but I'm not the litmus. I have found use with these tools for taking on some nested set of tasks, but at no point do I want to give up the app entirely.
For people who like shopping (not me!), most of it is actually browsing and there is a joy in sifting through options. The OpenAI designers seem to understand this.
Apparently, GPT told him that there were 4 house listings in the area and so he asked my why the agency took down our house listing, even though he could have just went to <house_listing_website> and searched for it. Took me 3 minutes to open my phone and disprove him.
I think they are designing an addiction of knowledge. I think people want to feel like they possess all the information at a moment's notice (mixed with misinformation served as fact), without having to spend the effort to look for it
That's already happened. The curated feed you see is a machine-learning driven output of an AI model that Spotify calls a "Large Taste Model", supplimented by a host of models trained using Spotify's NEO framework. It might look pretty but it absolutely is the output of AI. I'd bet a fair sum that FB, Insta, and YouTube are also showing you the output of a model now rather than a traditional application.
(unrelated; but this sort of paradigm would be heinously more expensive)
Please, no. Just TELL me; that's why I'm using voice to talk to you in the first place. Summarize and tell me, don't show me a list of links from a web search.....
Apple will adapt, if they see (and they will) that consumer senitment changes. Right now, 90% of regular "consumers" seem to despise AI and anything made by it.
1. OpenAI/Anthropic must purposefully not sell their service to Apple and/or users using Apple hardware.
2. Local models must not get any better or slimmer than they are today, such that they can not be ran by Apple or locally on Apple hardware. This is arguably not even the case today, there are open-weight models that rival the frontier models.
None of these two things are going to happen. Apple does not need their own models.
If Nvidia wanted they could end it overnight with a 60GB 6090.
However will they survive if they cede ground in commoditized consumer spaces to explore market fit in luxury goods?!
Do I want to set up my scale to sync its data to my vibe coded app? Not really. Do I want to set up the dozens of visualizations and hundreds of different actions and thousands of different items for calorie tracking, where even a 5% error is extremely significant? No way. Am I going to convince any of my friends to download my vibe coded chat application? Absolutely not. Do I want to store my photos in my own vibe coded solution and trust it to run in 20 years? Not a chance.
While a segment of apps will surely become obsolete, I don’t think the majority of users time will be spent on their own vibe coded replacements. Even as a developer I have no interest in turning all my conveniences into maintenance burdens, with risk of catastrophic failure
The issue is there will be less demand for apps. I don’t need to pay for a dulingo subscription when Claude can write a 5 minute language quiz for me. I don’t need to pay for Turbo Tax when Claude can prepare my tax documents for me.
Sure, it won’t replace all apps, but people will spend less time in apps and more time interacting with llms which hurts App Store revenue (Apples golden goose)
And it’s not like Apple is fixed. If this really did become a threat, Apple could surely integrate into Siri some ability to generate apps from your iPhone and put it behind their iCloud subscription.
They’ve had XCode for years, managed their entire UI library basically since conception, and have their own language for their apps. Fine tune DeepSeek for a while on swift iOS apps and I’m sure you could generate apps rivaling frontier models.
I really don’t see any existential threats for Apple here.
From what I have seen you belong to the vast majority. Though not here on HN.
Commodities like todo apps and calculators rarely compete on features, they compete on product design. This includes look and feel, relation between elements, design choices on what exact common features are available.
All products are, at their essence, just a set of design decisions stitched and shipped together.
Now, making these design decisions is hard. It requires knowledge, consistency, and insights into how real people operate real products. Even as a sole user of the app you build you rarely know what you actually need.
LLMs are 'design-less' in their essence. Building your own todo app takes literal seconds and it all looks simple because LLMs will default most of these design decisions for you - until you try to use your new app daily and notice it somehow sucks. Building a good todo app or good calculator requires tweaking, publishing, polishing, and solving bugs, testing, rinse and repeat.
Another tricky side of this is that you might know logically what features you want, but you are not selecting one product over another logically. You need to try and see if that works for you, all the vibes and good parts and bad parts and design choices and colors, till you find something that "clicks" for you. Using pure Claude as a todo app only works as long as you want to have more Claude in your daily life.
In the meantime app store provides dozens of well-reviewed alternative solutions which look good and require zero maintenance.
And that's just a calculator or todo app. Non-commodity apps are even harder than that.
I don't see any future where programs follow the static nature of old paradigm programming. A nice intuitive UI? What about just telling the app what I need when I need it? The gold standard of consumer UI is...another person.
If I have a team of god tier SWE's at my disposal, why the fuck am I fumbling around in an actions panel? The program can just be dynamically modified in real time to be whatever I need it to be in that moment.
If you extrapolate LLMs out to their extreme, you get a shape-shifting liquid array of bits in memory that manifest anything at the behest of a completely natural language interface.
Absolutely not. Constraining the set of possible actions instead of having you verbalise what you want every time is often a feature, not just a technical limitation. A camera with a shutter button is better design than having to tell the camera “please take a photo”.
At the supermarket, I personally also prefer the self-checkout machines over going to a human cashier.
The UI is totally fluid at all times, because an "intelligence" is actively manifesting it at all times. Nothing needs to be hard coded.
Hell the computer might even see your face, see your age and style, and be like "Yup, this guy definitely wants to checkout with a dumb, midi keytone 8-bit styled program"
But already AI design is everywhere and regular people don't even notice. It's only going to get better as people can interact with the design the same as the interact with another person.
The only reason it works out in my favor is that I enjoyed doing it. Normal people don't want to fuck around with that kind of shit.
You're also assuming that there are no negatives to saying what you want compared to just acting on things, but since the beginning of computing many people have proven this wrong time and again. I suggest you read about HCI as a research field and its history, it doesn't take much to realise how limited the average HNer's understanding of UI/UX design is, and how far current LLMs are from the skills required to be able to carefully design an app for productive human use.
Good design rarely calls for a “you can do everything” approach. Good design is often context specific and subtly guides users to better outcomes.
Doctor appointments would absolutely suck if I had to navigate decision trees and click buttons to communicate my symptoms. Car blinkers would absolutely suck if I had to type “blink left” into a chat window before every turn.
Maybe it’s just the ‘tism, but I hard disagree that I would ever say another person is a superior interface into… anything? It’s slow, they may misinterpret you, they have their own ideas and motivations, they’re (mostly) expensive because the only reason I need them is because there’s information / skill asymmetry. I don’t know that many or even most of those problems are resolved with ai, in some ways the problems are amplified.
I like to customize my Neovim setup or terminal and a bunch of scripts that I keep making them nice and maybe my blog and so on.
I don't want to become the PM of every app I need. But I do agree changes will happen to the current apps and how we buy and use them. Not sure exactly where it will settle. But still unknown unknowns and domain knowledge and vocabulary is not yet allowing anyone to build their own apps unless for simple cases.
Or maybe it is just me: I want someone else to think about my accounting app. I dont want to spend time to learn and understand and keep myself up to date or setup a series of LLM sessions that navigate and watch laws and propose changes.
Why do you need an accounting app when you have an accountant?
Programs of the future will in no way resemble what they are today. I don't even want to call it a "program" because in my head it's more like an intelligent digital liquid that can rapidly flow into any state. This flash-in-the-pan 50 year archaic era of software will look like what the oil lamp looks like today. A crude intermediate tech during a time of much larger transition.
it's nice to see my financial situation at a glance, without asking my accountant.
speech/text is one modality. we humans are also visual and tactile. and we need consistency and recurring patterns of interaction to function well.
Same thing for your accountant.
Imagine that both of them, while being good at their respective jobs, are also software engineers that can mint a custom throwaway app for you at a moment's notice.
I'm sure your secretary will make a note of your preference.
Sounds cumbersome, slow to use, and prone to failure.
However, you could expect LLMs to train on existing successful apps and hardened design patterns that compose well into good UIs. In that case, you might expect the last mile polish to be the differentiating factor. However, the more marginal this last mile becomes, the more other social, political, business, etc. forces will determine which app rises and which falls. But this has always been the case, certainly in software.
If you meant training on UI and features of established apps then it gets even more complex, as success of B2C apps is obscured by their pricing strategies and marketing, and business models for successful B2B apps like Jira/Confluence/Office often revolve around sales, partnerships and other non-product things like that.
Any business is a set of design decision someone made, with their app just being a small subset of these.
I dont think llms are going to replace banking apps anytime soon. But I no longer look for an app to pull data from my Peloton app into another exercise app. LLMs can build an app or a script that will do that and I wont have to pay some annual or monthly fee. It feels like these types of apps are going to die off.
I think it's better when you are at the origin, and the software branches off of your taste. For so long, we had to adapt and accept the ways of established software because it would take so long to make something of your own. Now it's both cheap and fast to iterate.
I recently used a coding agent to build a TV-like YouTube player for my mother, who is quite elderly. It's inspired by channelsurfer.tv, but runs on the Google TV Streamer in my living room. Unlike any set top box I've seen, it has on-screen diagrams that tell her which button to press on the remote to change the "channel." It doesn't have ads. The UI will never change unless I ask the AI to change it.
You can't say that about most apps in an app store. They will do a UI redesign and you're out of luck if you preferred the old version.
Do you really think Google or Apple or anyone else will build this app? Maybe some self-hosted media box out there would be similar, but I can't be bothered to search for one and I'm doubtful that any of them were designed for an elderly parent who isn't good with technology. It's still work in progress, but at least she can use a single remote to turn the TV on and watch TV without being bombarded with things she doesn't understand and doesn't care about.
There are downsides that make this app less compelling for other people, but I didn't build the app for them.
There's a recent benchmark indicating Hermes Agent and, I think, Qwen's harness are far and away the most effective.
Pi isn't bad but it doesn't seem as talented as Hermes. Nor does it currently array of self-learning/adaptive plugins seem as capable. That said, it's difficult to keep track of the SotA with pi; it grows like the node ecosystem in its first year.
But we are not there yet.
Whatever "good design" is (and it varies by user), it's very easy to copy. Commodity apps complete on marketing. Companies who charge $10/month for an app, are probably spending $8/month in marketing/advertising.
At the end of the day, it seems we'll be left with a decision of using something made by a person with real opinions or using something generated by AI with opinions that are a distillation of past documentation fed into it.
We're in this weird spot now where we are transitioning toward all ui feeling the same, and only the people really tuned in even notice this. Once the general public starts noticing, I believe there's going to be a search for fresh, organic, opinionated software. Not that the software won't be AI-generated, but it will have a human truly sculpting it, like art.
So the question becomes, if people still appreciate human-made art in a world where a better image can be generated in a small fraction of time via a prompt, will they feel the same way about the software they use?
This always puzzled me. Here's how that would go:
1. A new company, NeoPhone, launches that is redesigning a new "AI forward" phone.
2. The customers of that phone start noticing that they do many repetitive things with their phone, that they want the ability to design some repeat experiences with their chatbots. Call these repeat experiences "applets." Neophone ships some Applets on their phone that they created, a default set.
3. Customer A looks at customer B's phone, and notices their different applets that they designed. They work slightly better than customer A's applets, because customer B is slightly better at prompting.
4. NeoPhone notices this too. They create a new thing on their phone, the Applet store, where customers can share their applets and rate them and it surfaces the best ones to all customers.
5. Customers start complaining that they wish they had more creative control over Applets. Maybe the API is a bit more restrictive than they need, or the Applet needs to do special things with the phone's hardware, outside the context of the AI agent. Or they find that Claude Opus Fable 6.2 is better at making Applets even than NeoPhone's available chatbots.
6. NeoPhone allows 3rd party developers to develop on its phone, launching an "App Store" and a "Chat API" that is totally independent of the AI agent stuff.
???
Of course, Apple eats their lunch at step 2 or 3.
Would you trust access to your bank to a vibecoded phone of unknown origin? Backs will likely limit access as best they can for customer security. We already have banks who block GrapheneOS.
Look at the hardware wallet company that got sold and a spy chip to steal the contents was added.
I do believe AI is going to destroy companies like Adobe however.
This is the new reality that we must prepare to accept. You and I may not trust the companies, but the circle is closing in, and people around you are already on the "hype train".
Huh? I just took a look at my phone -- I have about 100 apps on there, though probably only use 20 of them with any regularity. I don't see more than a small handful that could be replace with Claude (if it had access to the APIs that the app does),
And even then, a chat interface isn't the optimal way to interact with many services. Random example: A simple metronome / tuner. Could I ask Claude to play a tick at a certain frequency for X amount of time, or a E-flat? Sure. Would it be easier than using the app? No. Could Claude design a metronome app for me? Yes, but I don't want to have to deal with that -- I just want a metronome app that works and I don't have to spend time designing or fiddling with, and that works offline, and all of that is well worth the $5 I might spend to buy it.
Apple is absurdly late to the game. The MLX community looks anemic compared to Linux.
So far, I prefer tailnet to my home Hermes agent inference system and giving it ssh into my Mac.
It's easier having a single powerful inference system.
A Claude Pro account and Openeouter credits are my backups.
You’re so DELUSIONAL. It’s hilarious.
Show us your portfolio of work as an innovator - just to ensure you have substance to support thes ridiculous claims.
Example - search iPhone Settings.
The Apple platform provides certain benefits to me. Take a look at Matthew Cassinelli' work (great speaker), if you have time (and a Mac I guess):
https://matthewcassinelli.com/sirishortcuts/library/#element...
His work is a library of Apple Shortcuts, AI, etc., that does stuff for consumers, I suppose pro-users. He was on a recent MacBreakWeekly podcast - https://twit.tv/shows/macbreak-weekly/episodes/1050?autostar...
The bits of AI mixed the platform affordance to simplify daily paper cuts by clicking on an icon is worlds apart from a Google SWE spawning 48 "agents" to parse lidar data to discover pyramids in Mexico. That's also cool.
Why, though? They had a sufficient mountain of cash to outbid everyone else for TSMC capacity, and no realistic hope of catching up to TSMC's process on their own fab
Also, I'm not exactly sure we should be claiming what is and what isn't realistic for a trillion-dollar company. People could (and probably did) argue that they had no hope of catching up to Intel/AMD, and yet here we are, with Apple arguably having surpassed both, at least from an energy efficiency point of view.
Realistically speaking, "catch up to TSMC" is something that every single EUVL fab has failed to do despite tens of billions of dollars in investment. Spending money is the easy part, developing high-yield processes over a timetable of decades is the hard part. I think Nvidia and Apple both agree that paying TSMC to build American fabs is a smarter use of their money if they just want excess fab capacity.
But the hardware. The hardware is fantastic for local LLM's, generative ai, etc. And they seem to maybe finally be waking up to that, in true slow sleepy Apple fashion.
Local models literally cost more in electricity than using far more powerful cloud models cost in inference.
When your options are "dramatically drain your iPhone battery for substandard AI, or have instantaneous cloud AI with no battery drain" what do you think the average user will choose?
And that's before we discuss how ridiculous the pricing is for home hardware that has a chance of running a halfway decent model at a halfway decent speed.
I think the future prospects for local AI are looking worse than ever. It will be far more expensive for a far worse experience for the foreseeable future.
Afterwards we’ll have 128gb apples for under 10k.
NVidia aggressively segments the market on VRAM. Apple’s shared memory model is a competitive advantage. Well, it will be when they hand the raw PFLOPS, which is coming.
Distillation works: we can get models leaner, have better performance with lesser and lesser parameters, more efficient. Apple gets this and we'll see the result with M7 Max/ultra chips and I reckon this will be one of the titular apps when M7 line of chips are introduced.
I guess it explains the haste Anthropic and OpenAI are in to IPO, cash out and leave the the retail investor holding the bag.