News for hackers. Stuff that matters.
Re:M5 Ultra Mac Studio Review: The Dream Mac for Local AI Ag... by peri-cl on Monday September 21, 2026 @12:12PM (#49789207)
Surprisingly, the Reddit crowd are reporting 50-60 tokens/s (for the 32 GiB 5090 + 128 GiB RAM)—on par with the M5 Ultra benchmarks, despite both the PCIe bottleneck and much lower RAM bandwidth,

https://old.reddit.com/r/LocalLLaMA/comments/1wl06np/qwen38f...

(Note it's a sparse MoE with only 6B active).

Re:M5 Ultra Mac Studio Review: The Dream Mac for Local AI Ag... by nacs on Monday September 21, 2026 @12:24PM (#49789397)
Good to know thanks.

That's with CPU offload to a DDR5 6000 RAM though which is around $3-4k at least.

Re:M5 Ultra Mac Studio Review: The Dream Mac for Local AI Ag... by well_ackshually on Monday September 21, 2026 @02:36PM (#49791433)
Unlike a 256GB M5 Ultra that is $10k+.
Re:M5 Ultra Mac Studio Review: The Dream Mac for Local AI Ag... by nacs on Monday September 21, 2026 @03:35PM (#49792237)
Apple product won't be the cheapest but it is a full package (CPU, RAM, VRAM/GPU, fast-storage, etc).

If you look at the pricing of a full (x86) AI workstation you'd need around the nvidia GPU, you'd approach $10k easily (and be using a ton more wattage too).

Re:M5 Ultra Mac Studio Review: The Dream Mac for Local AI Ag... by cma on Monday September 21, 2026 @08:51PM (#49795482)
But the 5090 they use there is now going low stock and selling for over $7500 in some places.
Re:M5 Ultra Mac Studio Review: The Dream Mac for Local AI Ag... by bitexploder on Monday September 21, 2026 @03:53PM (#49792476)
I have a 3 year old gaming system. RTX 4080 w/128GB of DDR5. It runs Qwen 38 Flash around 44-40 t/s with 128K context. It is on a specialized build that caches MoE experts and uses an optimized 3bit quant that basically is within a few points of the full 8 bit quant. In general, in casual benchmarking with Alibaba's endpoint I could not tell much of a difference. Overall this model is very good on long horizon agentic work. The main pain point for it is that its input processing speed is slow. Regardless, it gets meaningful work done.

I paid $500 for the RAM in Nov 2023 :)

Re:M5 Ultra Mac Studio Review: The Dream Mac for Local AI Ag... by peri-cl on Monday September 21, 2026 @04:31PM (#49792970)
> "I paid $500 for the RAM in Nov 2023 :)"

No wonder Warren Buffet gave up and resigned.

Re:M5 Ultra Mac Studio Review: The Dream Mac for Local AI Ag... by bitexploder on Monday September 21, 2026 @07:10PM (#49794689)
Right? To get comparable brand and quality DDR5, which isn’t particularly great at AI anything it is ~$2000. All you had to do was start hoarding 3090 GPU and RAM in 2023. It is unhinged.