News for hackers. Stuff that matters.

A comment on A Grace Blackwell AI Supercomputer on Your Desk – Nvidia DGX Spark. Parent comment

Re:A Grace Blackwell AI Supercomputer on Your Desk – Nvidia ... by aurareturn on Thursday August 28, 2025 @04:48AM (#45049916)
You'd have to stack 16 of these to get 2TB of VRAM, equivalent to 4 Mac Studios 512GBs chained together.

16 compared to 4. Surely even much faster networking in the Spark would degrade with that many devices?

Biggest problem with Macs is that they don't have dedicated tensor cores in the GPU which makes prompt processing very slow compared to Nvidia and AMD.

[ Parent | on HN ]
Re:A Grace Blackwell AI Supercomputer on Your Desk – Nvidia ... by themgt on Thursday August 28, 2025 @05:31AM (#45050190)
n.b. there's been a little speculation that Apple adding TensorOps to Metal 4 suggests M5/M6 may get tensor cores.

https://x.com/liuliu/status/1932158994698932505

https://developer.apple.com/metal/Metal-Shading-Language-Spe...

[ Parent | on HN ]
Re:A Grace Blackwell AI Supercomputer on Your Desk – Nvidia ... by aurareturn on Thursday August 28, 2025 @07:23AM (#45050836)
Nice. I hope so. That would make Macs the best local LLM machines for the masses by far.
[ Parent | on HN ]
Re:A Grace Blackwell AI Supercomputer on Your Desk – Nvidia ... by thomasskis on Thursday August 28, 2025 @11:00AM (#45053056)
It’s $12k for each Mac Studio, and the networking makes them only effective individually (it’s like less that 15 tokens/s with EXO) while NVLINK is very effective. The Spark is definitely more scalable, but the MLX and metal teams are cooking, so honestly either way is still winning.
[ Parent | on HN ]