News for hackers. Stuff that matters.
Re:Apple to skip high-end M6 Mac chips in favor of AI-focuse... by MisterKent on Thursday June 25, 2026 @10:44PM (#48681780)
Apple is actually interesting. They are one of the few companies with a chip / PC play with real power AND basically no play I'm the hyperscalar market.

That means they're actually incentivized at least short term, to benefit PCs becoming strong enough to do local LLMs. Which makes this play make even more sense. Though, I've been saying for a while that the local AI inflectiom point is the death knell for these frontier labs.

Re:Apple to skip high-end M6 Mac chips in favor of AI-focuse... by matheusmoreira on Thursday June 25, 2026 @11:32PM (#48682054)
Indeed. If Apple makes it feasible to run models like GLM 5.2 at home, I will become their customer.
Re:Apple to skip high-end M6 Mac chips in favor of AI-focuse... by Abishek_Muthian on Friday June 26, 2026 @12:00AM (#48682184)
It's plausible but is the Apple Tax for a 1TB memory machine on top of current memory prices really worth it? I paid around $4000 for 4090m laptop with 16GB VRAM back in 2023, it's great but DoA for even quantized LLMs. I can run SLMs and fine tune it but that's it.

We need one of those specialized inference chip startups to succeed and a PC manufacturer willing to bet on them against Nvidia for the local AI to find mass market appeal.

Re:Apple to skip high-end M6 Mac chips in favor of AI-focuse... by lowkeyokay on Friday June 26, 2026 @12:17AM (#48682262)
I recently bought a Mac mini M4 16 GB - mostly to run Immich. I assumed I needed a Linux box. After a lot of researched I was quite surprised that the mac was the cheapest option. So not always an Apple tax.
Re:Apple to skip high-end M6 Mac chips in favor of AI-focuse... by realusername on Friday June 26, 2026 @04:08AM (#48683780)
> After a lot of researched I was quite surprised that the mac was the cheapest option

For Immich, the cheapest option will either be a NAS or a used laptop depending on the amount of data you need, I wouldn't buy a mac for that.

Re:Apple to skip high-end M6 Mac chips in favor of AI-focuse... by Mashimo on Friday June 26, 2026 @04:57AM (#48684166)
Maybe he wants really fast or large AI models inside immich?

(I just run the defaults on my CPU, works for me)

Re:Apple to skip high-end M6 Mac chips in favor of AI-focuse... by realusername on Friday June 26, 2026 @05:03AM (#48684206)
I'm not sure why you would need large AI models for Immich, the face detection is pretty cheap and will run on 10 year old hardware without a blip.

I think the decision comes primarily on how much data you would like to store for Immich, if you want to go cheaply, a 100 bucks used laptop will do the job, if you have too much data, a NAS will be more suitable (and you are certainly not going to get a mac where you can plug multiple internal hard drives for the price of a NAS)

Re:Apple to skip high-end M6 Mac chips in favor of AI-focuse... by Mashimo on Friday June 26, 2026 @05:34AM (#48684428)
Not for faces, but the CLIP model for the context search https://docs.immich.app/features/searching/

That needs to be in (v)ram for searches.

Re:Apple to skip high-end M6 Mac chips in favor of AI-focuse... by realusername on Friday June 26, 2026 @07:31AM (#48685404)
That can be yeah but personally I wouldn't pay 3 times the amount you would pay normally just for that feature in particular.
Re:Apple to skip high-end M6 Mac chips in favor of AI-focuse... by Mashimo on Friday June 26, 2026 @07:54AM (#48685575)
Yeah, me neither. Fast enough for me on CPU.
Re:Apple to skip high-end M6 Mac chips in favor of AI-focuse... by ramesh31 on Friday June 26, 2026 @02:01AM (#48682870)
>" After a lot of researched I was quite surprised that the mac was the cheapest option. So not always an Apple tax."

Apple has always been the most cost effective choice for the value you get going all the way back to the Apple II, it's just that the floor of that cost has always been high. Anyone who thinks otherwise is a just a fanboy one way or the other.

Re:Apple to skip high-end M6 Mac chips in favor of AI-focuse... by oblio on Friday June 26, 2026 @04:11AM (#48683811)
Hmmm, not always. Between at least 1998 and 2005, PCs were just better. Better CPUs.
Re:Apple to skip high-end M6 Mac chips in favor of AI-focuse... by Abishek_Muthian on Friday June 26, 2026 @02:56AM (#48683241)
That's true only for the entry level macs. My M4 Mac Mini has the best Performance/value. But my workstation laptop with 32 cores, 96GB DDR5, Nvidia GPU costs lesser than Macs with lesser performance; not to mention I upgraded the RAM post purchase.
Re:Apple to skip high-end M6 Mac chips in favor of AI-focuse... by nok22kon on Friday June 26, 2026 @04:00AM (#48683720)
RAM upgrade possibility has a downside though - very low RAM bandwidth, which is highly relevant today if you want to run local LLMs
Re:Apple to skip high-end M6 Mac chips in favor of AI-focuse... by nottorp on Friday June 26, 2026 @05:37AM (#48684462)
It really depends what you factor in as value, because wintel laptops like you described tend to require noise canceling headphones when working on them.
Re:Apple to skip high-end M6 Mac chips in favor of AI-focuse... by Abishek_Muthian on Friday June 26, 2026 @11:18AM (#48687691)
True, can't beat current Apple chips on power efficiency.
Re:Apple to skip high-end M6 Mac chips in favor of AI-focuse... by ProZsolt on Friday June 26, 2026 @10:11AM (#48686850)
If you're happy with the base model, then Apple has a great value/price ratio, but there's nothing below it and any upgrade is really bad value for the money.
Re:Apple to skip high-end M6 Mac chips in favor of AI-focuse... by seanmcdirmid on Friday June 26, 2026 @12:31AM (#48682329)
If you think the apple tax is high you should see the nvidia tax.
Re:Apple to skip high-end M6 Mac chips in favor of AI-focuse... by 9dev on Friday June 26, 2026 @02:46AM (#48683188)
> I paid around $4000 for 4090m laptop

That's how much many developers currently spend on tokens - every day. Whatever "Apple Tax" applies to a device that can run a capable model offline will amortise itself in a blink.

Re:Apple to skip high-end M6 Mac chips in favor of AI-focuse... by Abishek_Muthian on Friday June 26, 2026 @03:30AM (#48683487)
>Whatever "Apple Tax" applies to a device that can run a capable model offline will amortise itself in a blink.

Current high-end Mac Studio with 32-core M3 Ultra chip and 96 GB of memory is $6800, 96GB is not enough to run GLM 5.2 without extreme quantization or stacking HW; but for the sake of discussion let's run quantized version on a single high end Mac Studio.

GLM 5.2 Max plan costs $ 112/m, so it would take ~60 months to recover the costs assuming the machine was bought just for AI. By then the current AI landscape would have changed drastically.

I use local AI on both Linux and Mac every single day, there's freedom, privacy and peace of mind in running the model locally. But I feel cost/value of local AI is overblown.

Re:Apple to skip high-end M6 Mac chips in favor of AI-focuse... by oblio on Friday June 26, 2026 @04:33AM (#48683984)
In what sustainable world outside of Bay Area jobs do devs spend 120k on tokens monthly?
Re:Apple to skip high-end M6 Mac chips in favor of AI-focuse... by 9dev on Friday June 26, 2026 @04:55AM (#48684144)
Nobody said anything about sustainable, or outside of the Bay Area really
Re:Apple to skip high-end M6 Mac chips in favor of AI-focuse... by oblio on Friday June 26, 2026 @05:10AM (#48684260)
Apple can't make devices they sell to 1000 people once, so yes, you did say that, implicitly.
Re:Apple to skip high-end M6 Mac chips in favor of AI-focuse... by jmyeet on Friday June 26, 2026 @05:37AM (#48684458)
"Apple tax" is such a lazy and inaccurate accusation to level. Sure we've had expensive wheels on the cheese grater (ie Mac Pro) but we've also had:

1. When Apple came out with the real Macbook Air in 2010/2011 (not the silly 2008 one), nobody could compete with it with those specs at that price and they couldn't for years. And every competitor usually sucked in some major way, most often the trackpad;

2. The Mac Mini is an outstanding piece of hardware for $600. Or was;

3. I've generally found that "Apple tax" complaints levelled against the iPhone to be nothing more than Android cope;

4. The M-series silicon has been an absolute game-changer. I honestly thought the first-generation M1s would be not great but they came out swinging. And the price points for these Macbooks have all been great, much better than the last-gasp-of-Johnny-Ive touch bar butterfly keyboard series, which were objectively awful.

Re:Apple to skip high-end M6 Mac chips in favor of AI-focuse... by jeron on Thursday June 25, 2026 @11:47PM (#48682124)
you're not a customer of any of their products at all already? not a single apple device in your household?
Re:Apple to skip high-end M6 Mac chips in favor of AI-focuse... by seabrookmx on Friday June 26, 2026 @12:12AM (#48682234)
I didn't have a single Apple device in my house until a month ago when I bought a Neo. The last Apple devices I had before that were an iPod Nano and a PowerMac G5 many many years ago.

Apple has pretty good competition in every segment with the exception of maybe the iPad, but I'm not a tablet user.

Re:Apple to skip high-end M6 Mac chips in favor of AI-focuse... by esperent on Friday June 26, 2026 @12:11AM (#48682232)
[delayed]
Re:Apple to skip high-end M6 Mac chips in favor of AI-focuse... by matheusmoreira on Friday June 26, 2026 @12:09AM (#48682221)
Correct. Been using Linux and Android for over ten years. My household had no Apple devices until I got married.
Re:Apple to skip high-end M6 Mac chips in favor of AI-focuse... by AgentElement on Thursday June 25, 2026 @11:51PM (#48682145)
Some folks like to have a computing environment free of proprietary influences and extremely strong vendor lock-in. I cannot claim to posses any apple devices.
Re:Apple to skip high-end M6 Mac chips in favor of AI-focuse... by rjrjrjrj on Friday June 26, 2026 @12:06AM (#48682210)
How does the Mac have extremely strong vendor lock-in?

Sure, you can use the App Store and use all the stuff that integrates with iPhone, iCloud, etc

But you can also just treat it as Linux for Laptops (that actually works), and roll with all the standard open source tools.

Re:Apple to skip high-end M6 Mac chips in favor of AI-focuse... by seabrookmx on Friday June 26, 2026 @12:13AM (#48682242)
I don't disagree with you, but technically speaking MacOS is still proprietary and Asahi is not compatible with the latest and greatest Apple devices.

While they don't _prevent_ Asahi from doing what they're doing, they certainly don't go out of their way to make it easy for them.

Re:Apple to skip high-end M6 Mac chips in favor of AI-focuse... by rjrjrjrj on Friday June 26, 2026 @12:26AM (#48682299)
I wasn't thinking of Asahi. Just pointing out that you can run all the standard unix/open source tools and apps on Mac OS (vi, git, qgis, blender, vsc, python, node, etc). With the advantage of higher quality hardware and generally less fiddling.

But if you don't like it, switch. I don't see vendor lock-in.

Re:Apple to skip high-end M6 Mac chips in favor of AI-focuse... by rhdjcnfj373 on Friday June 26, 2026 @01:49AM (#48682788)
A lot of convenient things come with the lock-in if you have >1 device

Notes sync, Copy/Paste would be hard to give up and took zero effort

Re:Apple to skip high-end M6 Mac chips in favor of AI-focuse... by nicoty on Friday June 26, 2026 @02:48AM (#48683196)
I don't now how the MacOS equivalent compares, but Linux/Windows has KDE Connect that I use for that https://kdeconnect.kde.org/
Re:Apple to skip high-end M6 Mac chips in favor of AI-focuse... by croes on Friday June 26, 2026 @12:48AM (#48682433)
Apple is also iOS
Re:Apple to skip high-end M6 Mac chips in favor of AI-focuse... by NamlchakKhandro on Thursday June 25, 2026 @11:54PM (#48682157)
Not. A. Single. One.
Re:Apple to skip high-end M6 Mac chips in favor of AI-focuse... by fhn on Friday June 26, 2026 @12:21AM (#48682275)
there a many people who don't own Apple. Why are you so surprised? I certainly don't and never will. What's it got that I can't get on a standard PC + Linux?
Re:Apple to skip high-end M6 Mac chips in favor of AI-focuse... by kombine on Friday June 26, 2026 @01:34AM (#48682705)
None. And I have a PC, a personal laptop, a work laptop, my current and my previous Android phone.
Re:Apple to skip high-end M6 Mac chips in favor of AI-focuse... by nchmy on Friday June 26, 2026 @01:40AM (#48682734)
What a bizarre bubble you live in to even be asking this question... I've never owned a single apple product, and never will.

And in the rare occasions in which I have to use someone's MacBook, I'm completely lost - like some elderly person.

Re:Apple to skip high-end M6 Mac chips in favor of AI-focuse... by overfeed on Friday June 26, 2026 @12:30AM (#48682328)
> Though, I've been saying for a while that the local AI inflectiom point is the death knell for these frontier labs.

"Death knell" is a touch hyperbolic. Hardware that can only run quantized models that take up GBs in VRAM falls short of even an A100 (by almost an order of magnitude[0]), which in turn falls short of what an 8xH100 cluster can do (also by another order of magnitude[0]).

I'm an avid believer in local LLMs, but I cannot deceive myself - data center accelerators will win on power dissipation numbers alone[1], even when giving generous allowances for higher efficiency on Apple chips - and assuming the Apple-efficiency advantage persists on the same TSMC process node.

0. Based on my unscientific fine-tuning training experiments across local and rented GPUs. YMMV for inference.

1. Unless Apple surprises everyone and brings back the XServe with M7, if not, then laptop and desktop for factors simply can't dump heat fast enough to compete head-to-head, and will be designed for lower input wattage.

Re:Apple to skip high-end M6 Mac chips in favor of AI-focuse... by kennywinker on Friday June 26, 2026 @12:44AM (#48682413)
Doesn’t need to be a winner head to head. If it can do 90% of the tasks the big boys do, at 50% speed, for virtually no extra overhead cost save for the power consumed by a prompt - that’s gonna work for a lot of people. And that’s also basically where we’re at today. Qwen3.6 35b running quantized on 10 year old hardware solves basically all of my uses cases for agents except for coding.

The frontier models are faster, and better at coding, but not so much that i’ll pay $200/month for them.

Re:Apple to skip high-end M6 Mac chips in favor of AI-focuse... by drnick1 on Friday June 26, 2026 @01:17AM (#48682589)
Consider this. One of the smallest Qwen models (4B parameters) powers my home automation voice assistant, and runs on CPU alone at >20 tok/s. It is enough for that use case, and could be made even better/faster with a modest GPU. It isn't as smart as some cloud-connected thingamajig, but I would never allow a literal Google or Amazon bug in my home. Huge SOTA models aren't relevant everywhere. Most people use LLMs for rather trivial tasks such as finding typos or drafting text.
Re:Apple to skip high-end M6 Mac chips in favor of AI-focuse... by marci on Friday June 26, 2026 @02:54AM (#48683229)
But with Apple's AFM 3 architecture, we might end up with huge SOTA adjacent on devices with limited RAM.

They use a technique where you only load between 1B and 4B of a 20B dense model for an entire prompt run, not token by token like a MoE, and use mostly the low power ANE instead of GPU cores.

Now, imagine if/when they scale up to 100B or more? On a chip using 2W?

Re:Apple to skip high-end M6 Mac chips in favor of AI-focuse... by kinnth on Friday June 26, 2026 @04:02AM (#48683728)
I think we're also ignoring a potential innovative move in how models work.

If someone could splinter or fragment the models into more specific tasks i.e "spellchecker AI" and get these working as well as Sonnet 4.6-4.8 on those tasks on a personal laptop. You then question the $100 a month fee.

Bear in mind these laptops are likely to be $5000 or so because of the memory, HDD and M7 chip they likely need.

It feels to me like the beginning of the inflection point but software updates not hardware updates will be the accelerant.

Re:Apple to skip high-end M6 Mac chips in favor of AI-focuse... by marci on Friday June 26, 2026 @05:57AM (#48684616)

  "That’s where EMO comes in.

  We show that EMO – a 1B-active, 14B-total-parameter (8-expert active, 128-expert total) MoE trained on 1 trillion tokens – supports selective expert use: for a given task or domain, we can use only a small subset of experts (just 12.5% of total experts) while retaining near full-model performance."
https://allenai.org/blog/emo
Re:Apple to skip high-end M6 Mac chips in favor of AI-focuse... by dainiusse on Friday June 26, 2026 @02:25AM (#48683030)
Curious, what exactly does it do for you? I has bad luck with these small models to do anything useful tbh.
Re:Apple to skip high-end M6 Mac chips in favor of AI-focuse... by drnick1 on Friday June 26, 2026 @01:05PM (#48689017)
It's a voice assistant that can respond to commands such as "turn on the light," or explain things (within the abilities of the small model).
Re:Apple to skip high-end M6 Mac chips in favor of AI-focuse... by overfeed on Friday June 26, 2026 @01:47AM (#48682778)
> If it can do 90% of the tasks the big boys do, at 50% speed

I want to live in this world too, but these numbers, as of today, are very aspirational and far removed from reality.

I'm no tokenmaxxer; I find my modest local setup useful, I also know the limitations, it's slow and it sucks (relatively) at high-level and/or long-context planning, compared to frontier models. Only a minority of my prompts are max-effort - its not all I do, but, it also means frontier labs aren't dying any time soon

Re:Apple to skip high-end M6 Mac chips in favor of AI-focuse... by mikestorrent on Friday June 26, 2026 @02:13AM (#48682937)
Consider also that right now LLMs run slowly enough you can watch them think. I've seen a demo of an LLM running at an absurdly high speed and it reminds me of when I moved from a 2400 baud modem to a 14.4 - BBS screens that I could watch draw were all of a sudden nigh-interactive. Faster-than-realtime video generation is also coming, and will also continue to require huge hardware for a long while yet.

I love local models - I have a machine at home that runs a few for me and it's a lot of fun - but for the time being they are not super trustworthy on tool calls and staying on script. Another year or so might change all that!

Re:Apple to skip high-end M6 Mac chips in favor of AI-focuse... by ChickeNES on Friday June 26, 2026 @03:16AM (#48683380)
What does your local setup look like?
Re:Apple to skip high-end M6 Mac chips in favor of AI-focuse... by mikestorrent on Friday June 26, 2026 @08:29PM (#48693809)
1650 watts of liquid cooled Risc-V
Re:Apple to skip high-end M6 Mac chips in favor of AI-focuse... by KoolKat23 on Friday June 26, 2026 @04:34AM (#48683991)
If anyone wishes to see the future. A fast LLM is quite eye-opening. I think chatjimmy uses Talaas' chips where models are hardcoded into the silicon.

https://chatjimmy.ai/

Re:Apple to skip high-end M6 Mac chips in favor of AI-focuse... by calgoo on Friday June 26, 2026 @07:58AM (#48685604)
Yea, is almost "scary fast" in a sense... the amount of compute you can do in parallel one one of those chips is amazing. hopefully they get their next chip completed as that will be a lot more useful for general workloads. I think the current one is based on llama3.

*corrected llama version to 3

Re:Apple to skip high-end M6 Mac chips in favor of AI-focuse... by flyingjoe on Friday June 26, 2026 @04:56AM (#48684154)
Thanks, I didn't know that one! Very impressive speed although quality seems very bad
Re:Apple to skip high-end M6 Mac chips in favor of AI-focuse... by msdz on Friday June 26, 2026 @05:50AM (#48684566)
> although quality seems very bad

The weights they “etched” into the FPGA card that’s used for the ChatJimmy demo are that of a Llama 3-something 8b model.

The actually impressive and novel thing is that Taalas’ve managed to automate that process (clearly – nobody transforms 8 billion numbers into a physical representation by hand).

So now, they can work on scaling this process up, and with low enough lead times (I’ll be convinced they have inside connections to TSMC if they can actually deliver on the promised mere 3-4 months delay), will be able to offer 30-100b+ parameter models under half a year after they’re released, at thousands of tokens per second while probably drawing less wattage (per token, not sure about overall).

Exciting times ahead, folks.

Re:Apple to skip high-end M6 Mac chips in favor of AI-focuse... by mikestorrent on Friday June 26, 2026 @08:28PM (#48693802)
At some point we're going to have these chips for a couple bucks in kids toys
Re:Apple to skip high-end M6 Mac chips in favor of AI-focuse... by kennywinker on Friday June 26, 2026 @03:13AM (#48683363)
I’m sure you’re right, for the things you are asking of an llm, just as I am right about the things I am asking of an llm.

The real question is, what are 90% of people going to ask llms to do. I’d argue mostly it’s going to be stuff that works-now or almost-works on local models, but that’s just an opinion. It also depends on the frontier models hitting a wall of steeply diminishing returns, since they set the expectations for all of this stuff - my gut says that’s happened already they just won’t admit it for a while - but we’ll see.

Re:Apple to skip high-end M6 Mac chips in favor of AI-focuse... by SanjayMehta on Friday June 26, 2026 @02:56AM (#48683242)
This is what makes sense for me as well. All I need a local model is for playing with simple graphics: no gradients, at most ten colours which I can push through VTracer to get an SVG. Draw Things does the job, usually in 120 seconds or less.

Sometimes, I need a quick throwaway bit of python. That can take 30 minutes of my time.

Re:Apple to skip high-end M6 Mac chips in favor of AI-focuse... by everfrustrated on Friday June 26, 2026 @03:17AM (#48683391)
The established AI players have no financial interest to make LLM available locally. They aren't hardware companies and if running LLM requires paying them to host the models as well then they can naturally capture more of the value chain = more revenue.

Apple is the only player here where it would play into their natural hardware incentive to get you to pay more for better hardware. It would make sense for them to find a way to run LLM locally (eg, newer architectures that others here have pointed out).

Interesting times.

Re:Apple to skip high-end M6 Mac chips in favor of AI-focuse... by rjzzleep on Friday June 26, 2026 @02:56AM (#48683245)
Is it hyperbolic though? One of the best things about the compute and memory shortage is that people are going to insane lengths to optimize things to run on lower memory / lower compute devices. If we keep this up for a while and then ramp up memory and local compute production, that AI inflection point may actually come.

Of course, these are a lot of ifs.

Re:Apple to skip high-end M6 Mac chips in favor of AI-focuse... by spiderfarmer on Friday June 26, 2026 @03:02AM (#48683275)
If we advance just 2x in hardware plus 2x in software, all coding can be done on local hardware imho.
Re:Apple to skip high-end M6 Mac chips in favor of AI-focuse... by rbanffy on Friday June 26, 2026 @03:59AM (#48683711)
That’s about 4 years in hardware cadence alone. There is a lot of room to improve memory bandwidth, and performance is a given with every process node. IBM has shown yesterday they can do limited runs on 0.7nm (density equivalent).
Re:Apple to skip high-end M6 Mac chips in favor of AI-focuse... by dgellow on Friday June 26, 2026 @03:15AM (#48683371)
The thing is, with the level of hard investment AI vendors have, even a small reduction of their addressable market is significant. They aren’t profitable, and inference is getting commoditized fast, so even if they eventually become profitable (not via financial engineering) they won’t be able to have good margin. The pressure of both open models AND local models is pretty bad imho
Re:Apple to skip high-end M6 Mac chips in favor of AI-focuse... by lumost on Friday June 26, 2026 @02:32AM (#48683080)
The big question for local LLMs is whether there is a 100 tok/s model which requires less than 16 GB of memory and is competitive on most tasks with the cloud models.

There is some signal that this is possible through both hardware innovation and training/data improvements.

Cloud models have their own constraints - I can’t have opus4.8 spend 4 hours on a deep research question I had in the shower without spending money. I can’t do real time video game upscaling and graphics work in the cloud period.

A laptop is about an order of magnitude cheaper than a cloud server thanks to economies of scale, uptime requirements, and other factors.

Re:Apple to skip high-end M6 Mac chips in favor of AI-focuse... by nok22kon on Friday June 26, 2026 @03:51AM (#48683648)
if you do the electricity math you'll see that you pay more on local models while getting less (local is more heavily quantized) compared with OpenRouter.

I'm not talking local Gemma/Qwen vs cloud Opus, but against OpenRouter same Gemma/Qwen

there are reasons to run local - privacy, availability, but cost is not one of them

Re:Apple to skip high-end M6 Mac chips in favor of AI-focuse... by manarth on Friday June 26, 2026 @04:17AM (#48683869)
That's assuming consumption pricing remains as-is.

There has been a lot of market-subsidy in AI which is starting to fade away: e.g. the copilot quotas/pricing. When VC switches from investing to wanting a return, the price equation is likely to change.

Re:Apple to skip high-end M6 Mac chips in favor of AI-focuse... by nok22kon on Friday June 26, 2026 @04:25AM (#48683934)
There is no subsidy on most OpenRouter providers, they are profitable today.

You buy a big GPU, you serve LLMs, you print money.

Re:Apple to skip high-end M6 Mac chips in favor of AI-focuse... by brianwawok on Friday June 26, 2026 @07:50AM (#48685551)
And if you skip open router and go direct you save another 5%
Re:Apple to skip high-end M6 Mac chips in favor of AI-focuse... by JumpCrisscross on Friday June 26, 2026 @05:19AM (#48684323)
> do the electricity math

Could you give an example with real figures?

Re:Apple to skip high-end M6 Mac chips in favor of AI-focuse... by nok22kon on Friday June 26, 2026 @05:40AM (#48684484)
obviously depends on your location and GPU

for me it would be about $2 per day in electricity to generate 8 mil tok of Gemma4-26B at 4 bit quantization. this is excluding how much the GPU cost (no amortization)

ignoring the fact that I could get more free tokens per day for this model from Google/OpenRouter, it would cost $4 per day on OpenRouter if paid, but they would run it at full 16 bit precission

this would be the most "profitable" model for me

for Gemma4-31B I can generate only 1 mil tok per day, and so I pay more to get less quality than OpenRouter (ignoring that this model is also free on Google)

Re:Apple to skip high-end M6 Mac chips in favor of AI-focuse... by s1artibartfast on Friday June 26, 2026 @12:55PM (#48688904)
This is very interesting to me. How do you come up with the kwh/token for your setup?
Re:Apple to skip high-end M6 Mac chips in favor of AI-focuse... by nok22kon on Saturday June 27, 2026 @04:47AM (#48696391)
I know how many tokens per second my computer generates, and I have a wall power meter which measures how many watts my computer is using when generating.
Re:Apple to skip high-end M6 Mac chips in favor of AI-focuse... by calgoo on Friday June 26, 2026 @08:08AM (#48685696)
I am allowed to plug in 800w of solar panels into a wall socket here in spain. That would more then cover my current computer with 16gb vram. Now if i went and built a LLM server, at full load i would probably be closer to 3600w (Dual Epyc CPUs that gives you 8 x16 PCI channels and up to 8 cards - Way overkill, i know). If i half that with 1 EPYC and 4 x16 PCI channels, and add the same amd 7800xt i currently have then i should in theory be able to run at around 1800w under full load. Now that could still be covered with a 2000w solar install (get a professional setup OR get a battery unit like a EcoFlow that can output 2000w and can input about the same amount of solar).

Now, this all brings the upfront costs way up, the solar panels are cheap, its all the rest around them that tends to cost money.

Re:Apple to skip high-end M6 Mac chips in favor of AI-focuse... by re-thc on Friday June 26, 2026 @03:57AM (#48683695)
> The big question for local LLMs is whether there is a 100 tok/s model which requires less than 16 GB of memory and is competitive on most tasks with the cloud models.

Benchmarks maybe? Real world, no.

You just need the context otherwise. There's no way around it.

Re:Apple to skip high-end M6 Mac chips in favor of AI-focuse... by lumost on Friday June 26, 2026 @07:34AM (#48685420)
Context is more available locally. You can have the LLM operate for arbitrarily long periods, use your credentials to access services (if desired), store memory locally etc.

Whether such a model exists or not is a different question.

Re:Apple to skip high-end M6 Mac chips in favor of AI-focuse... by wisty on Friday June 26, 2026 @03:03AM (#48683289)
I'm not paying for a super computer to do my taxes if a cheap pc can do it for free.

So yeah, commercially it might be a death knell. Yes there's still a market for super computers, but would your rather own Apple or Cray?

Re:Apple to skip high-end M6 Mac chips in favor of AI-focuse... by rbanffy on Friday June 26, 2026 @04:04AM (#48683745)
> would your rather own Apple or Cray?

I would consider an HPE tower server with a processor on the same league as an M6 or M7 under the Cray brand.

Re:Apple to skip high-end M6 Mac chips in favor of AI-focuse... by interludead on Friday June 26, 2026 @04:00AM (#48683722)
I think this is right but it also depends on what "compete" means
Re:Apple to skip high-end M6 Mac chips in favor of AI-focuse... by rubyn00bie on Friday June 26, 2026 @12:59AM (#48682498)
We'll likely see a transformation in how frontier models are trained as a result of a push towards local inference. While it seems unlikely now, given current pricing for RAM, in 10-15 years it's not unthinkable to assume we could see individual machines with 10-12TB (and well beyond that) of RAM which are accessible to the GPU. Min/max system RAM increased a LOT from 2010-2025 and largely because it was cheap. Once the hyperscalers aren't generating revenue for the RAM manufacturers, I wouldn't be surprised to see a massive push towards consumers in order to maintain gross profit. Not to mention new players who enter the market because the margins are measurably absurd right now.

At some point there will be diminishing returns towards the "just throw more RAM at it" approach the current frontier models are taking. Commoditization is just as inevitable as it ever was... and in doing so will enable actual leaps of what AI/ML is capable of. That's not to say there won't be a place for 99.999999% accurate vs 99.99999% but those cases will be limited and likely prime to disruption based on real innovation vs access to capital.

Re:Apple to skip high-end M6 Mac chips in favor of AI-focuse... by Culonavirus on Friday June 26, 2026 @01:56AM (#48682828)
The 1080ti is out there for almost 10 years now. It has 11GB of VRAM. A 5090 has 32GB.

SOCs with unified memory have shifted this a bit forward, but they're also expensive as shit.

10TB ram in a consumer device is simply not happening in the next 10 years.

Re:Apple to skip high-end M6 Mac chips in favor of AI-focuse... by rjzzleep on Friday June 26, 2026 @02:57AM (#48683249)
Half a year ago you could get a AI max 395+ with 128GB ram in mobile form factor for ~$2200. The same thing costs $3700. Same SoC, same memory.
Re:Apple to skip high-end M6 Mac chips in favor of AI-focuse... by rbanffy on Friday June 26, 2026 @04:08AM (#48683782)
10TB is about 80 times that, 200K in today’s money. A lot of capacity is coming online in the next 5 years and it’s reasonable to think we can get there with better process and stacking (the latter does little for pricing, but enables shorter latencies).
Re:Apple to skip high-end M6 Mac chips in favor of AI-focuse... by jpc0 on Saturday June 27, 2026 @04:25AM (#48696283)
> A lot of capacity is coming online in the next 5 years

Is this true though? I don't really have time to do the research and have no dog in the race but I'm sceptical...

But then again I'm not there one making our profiting from the claims that there is billions being invested into infra...

Re:Apple to skip high-end M6 Mac chips in favor of AI-focuse... by interludead on Friday June 26, 2026 @04:04AM (#48683744)
I agree with the general direction but I'm a little skeptical of the "just add a few more TB of RAM and the frontier moves local" version of it
Re:Apple to skip high-end M6 Mac chips in favor of AI-focuse... by bitwize on Friday June 26, 2026 @01:26AM (#48682643)
Indeed. Local models becoming available and halfway decent don't obviate the laws of scale. And because there's no ceiling to what scaling more will buy you in terms of capability, there's no reason not to scale more, there's no incentive for billionaires not to grab all the fab capacity they can.

Enjoy paying $1000 or more for a little 4 GiB cloud terminal that connects you to all your online accounts where all your actual work gets done. This is the future.

Re:Apple to skip high-end M6 Mac chips in favor of AI-focuse... by colechristensen on Friday June 26, 2026 @01:50AM (#48682795)
>there's no ceiling to what scaling more will buy you in terms of capability

This is highly doubtful.

Rule of thumb: everything people think is exponential is actually an S curve.

Re:Apple to skip high-end M6 Mac chips in favor of AI-focuse... by nok22kon on Friday June 26, 2026 @03:57AM (#48683700)
better rule: exponentials are overlapping S-curves
Re:Apple to skip high-end M6 Mac chips in favor of AI-focuse... by bitwize on Friday June 26, 2026 @03:49AM (#48683634)
There's a limit that won't be breached without a fundamental breakthrough in physics of computation, but we're not there yet by a long shot. You can train bigger models, faster, and infer with them faster and more precisely, by throwing more compute at the problem for the foreseeable.
Re:Apple to skip high-end M6 Mac chips in favor of AI-focuse... by rbanffy on Friday June 26, 2026 @04:11AM (#48683808)
At some point, and I can already see it, they’ll be better than us at writing code. We are still in the loop to coerce them into architecting well, but that’s nothing magical.

What’s frontier now is prosumer in a couple years and commonplace in a couple more.

Re:Apple to skip high-end M6 Mac chips in favor of AI-focuse... by AnthonyMouse on Friday June 26, 2026 @07:08AM (#48685216)
> Hardware that can only run quantized models that take up GBs in VRAM

That's the today hardware.

Now suppose Apple goes to any of Samsung/Micron/Hynix and says "we'll pay you the entire cost of building another DRAM fab and in exchange we want its entire output" and then releases M7 devices with enough memory and compute to run bigger models.

> Unless Apple surprises everyone and brings back the XServe with M7, if not, then laptop and desktop for factors simply can't dump heat fast enough to compete head-to-head, and will be designed for lower input wattage.

Laptops maybe. Desktops can dissipate more heat than the amount of electricity you can draw from a typical household wall outlet.

Re:Apple to skip high-end M6 Mac chips in favor of AI-focuse... by overfeed on Friday June 26, 2026 @10:12AM (#48686852)
> Now suppose Apple goes to any of Samsung/Micron/Hynix and says "we'll pay you the entire cost of building another DRAM fab and in exchange we want its entire output"

It's revealing that they aren't doing this: no one wants to fund that gamble on the state of AI demand 12-18 months out, but ate happy to capitalize on their current product lines/capacity.

> Desktops can dissipate more heat than the amount of electricity you can draw from a typical household wall outlet

100% agree, but the data center power and cooling infra are not limited by home wiring, and go way beyond what a wall outlet can safely provide (1,440W max on a typical 15A circuit at 120V). A single H100 maxes out at 700W

Re:Apple to skip high-end M6 Mac chips in favor of AI-focuse... by AnthonyMouse on Saturday June 27, 2026 @04:59PM (#48701706)
> It's revealing that they aren't doing this

They are doing this. All three of the DRAM manufacturers are actively expanding capacity. It's just not an instantaneous process.

> 100% agree, but the data center power and cooling infra are not limited by home wiring, and go way beyond what a wall outlet can safely provide (1,440W max on a typical 15A circuit at 120V). A single H100 maxes out at 700W

A desktop with the performance and the 160GB of VRAM of two H100s would sell like hotcakes. The power consumption is also largely proportional to the amount of compute rather than memory, and can be significantly improved by using lower clock speeds and then either making up for it with wider silicon or just not caring that it can run the same model but is e.g. 25% slower than hardware that uses twice as much electricity.

Re:Apple to skip high-end M6 Mac chips in favor of AI-focuse... by VeejayRampay on Friday June 26, 2026 @02:19AM (#48682974)
I really wish people stopped saying things "I've been saying that"

why not just say "I think that"

do you see yourself as some kind of visionary about this particular topic? literally EVERYONE is saying that, it's the most obvious fact about AI

Re:Apple to skip high-end M6 Mac chips in favor of AI-focuse... by rajnathani on Friday June 26, 2026 @02:27AM (#48683043)
Tangential: About 8 years ago ex-Apple chip engineers left to design server-grade chips, this was Nuvia, and they got sued by Apple to the point that they had to get acquired by Qualcomm.
Re:Apple to skip high-end M6 Mac chips in favor of AI-focuse... by kasabali on Friday June 26, 2026 @05:00AM (#48684181)
Then, after getting acquired by Qualcomm they got sued by ARM.

So maybe they were assholes.

Re:Apple to skip high-end M6 Mac chips in favor of AI-focuse... by seabrookmx on Friday June 26, 2026 @06:49PM (#48693006)
Or maybe corporations hate competition. We'll never know!
Re:Apple to skip high-end M6 Mac chips in favor of AI-focuse... by genxy on Friday June 26, 2026 @03:40AM (#48683553)
I worked at a hyperscaler when the M1 came out. A MacBook Air M1, running a Linux VM was faster and more energy efficient than anything we had in the data center.
Re:Apple to skip high-end M6 Mac chips in favor of AI-focuse... by ac29 on Friday June 26, 2026 @06:22AM (#48684825)
I'm certainly willing to believe the M1 was the most energy efficient, but your data center didnt have anything faster than a laptop?
Re:Apple to skip high-end M6 Mac chips in favor of AI-focuse... by genxy on Friday June 26, 2026 @09:36AM (#48686511)
Nope, across all benchmarks, Linux running in a VM on the M1 had higher perf (4 cores) than any instance type I launched across Intel, AMD and Arm. Triad, coremark, openfoam, verilator, etc. This may have changed, but my hunch is this is still probably true with M5 vs all the cloud providers.
Re:Apple to skip high-end M6 Mac chips in favor of AI-focuse... by Marsymars on Friday June 26, 2026 @03:49PM (#48691152)
That's not especially surprising for low thread counts. e.g. if you look at the current Geekbench single core charts, the fastest device across Android/iOS/Mac/PC is the M5 MacBook Pro. Second-fastest is the M5 iPad Pro. The fastest PC CPU (9950X3D) is about 80% the performance of the M5. (And the 9950X3D is about on par with the A18 in the iPhone 16 from 2024.)

(All the usual caveats about geekbench scores apply, but they're not nothing.)

Re:Apple to skip high-end M6 Mac chips in favor of AI-focuse... by 6thbit on Friday June 26, 2026 @03:54AM (#48683672)
They do stand in front of a great opportunity that would also benefit consumers, which seems rare in the llm era.

If people can get opus4.6/gpt5.5-like models locally, labs could raise their prices and sell token speed, better reasoning, mobile-focused improvements, you name it.

Not all consumers are power users and many will be happy to pay for flexibility.

Re:Apple to skip high-end M6 Mac chips in favor of AI-focuse... by interludead on Friday June 26, 2026 @03:57AM (#48683699)
Most people don't actually want to manage models, updates, context limits, quantization, etc. They just want the thing to work everywhere
Re:Apple to skip high-end M6 Mac chips in favor of AI-focuse... by rbanffy on Friday June 26, 2026 @04:15AM (#48683847)
Once one person figures that out and writes a blog post, everybody else can do it.
Re:Apple to skip high-end M6 Mac chips in favor of AI-focuse... by oblio on Friday June 26, 2026 @04:37AM (#48684022)
Yes, just like 90% of regular users set up NASes instead of just using Dropbox or Google Drive.

https://xkcd.com/2501/

Re:Apple to skip high-end M6 Mac chips in favor of AI-focuse... by rbanffy on Friday June 26, 2026 @07:32AM (#48685408)
The comparison is against your own computer, which is powerful enough, no need to add a box and set it up, and a very expensive cloud service. It’s nothing like setting up a NAS versus using iCloud (because we are talking Apple here).
Re:Apple to skip high-end M6 Mac chips in favor of AI-focuse... by interludead on Friday June 26, 2026 @03:56AM (#48683685)
I'm not sure it's a death knell for frontier labs so much as a narrowing of what people need them for
Re:Apple to skip high-end M6 Mac chips in favor of AI-focuse... by oblio on Friday June 26, 2026 @04:38AM (#48684031)
When you've raised hundreds of billions in funding, every result except "to the moon" is a death knell.
Re:Apple to skip high-end M6 Mac chips in favor of AI-focuse... by oblio on Saturday June 27, 2026 @06:51AM (#48697097)
LOL at the downvotes. I'm sure that the shareholders aka wealthy people at the top have a lot of patience for huge gambles that don't pay off. If OpenAI and Anthropic turn out to be the IT equivalent of mom and pop stores 5 years from now, their current shareholders will be ecstatic!
Re:Apple to skip high-end M6 Mac chips in favor of AI-focuse... by ksec on Saturday June 27, 2026 @03:01PM (#48700755)
>AND basically no play I'm the hyperscalar market.

I do wish they have Xserve back, or a Mac Pro that is Rack Based and support multiple node with M6 Ultra. The Hyperscaler market is so large along with AI their old business case of Xserve didn't make sense no long hold true.