Re:A Grace Blackwell AI Supercomputer on Your Desk – Nvidia ...
by nodesocket on Wednesday August 27, 2025 @11:02PM
(#45047882)
Once the updated Mac Studio with M4/M5 Ultra comes out, pretty much going to make the DGX irrelevant right?
[ Parent
| on HN ]
Re:A Grace Blackwell AI Supercomputer on Your Desk – Nvidia ...
by wmf on Wednesday August 27, 2025 @11:10PM
(#45047929)
Ultras are pretty expensive.
Re:A Grace Blackwell AI Supercomputer on Your Desk – Nvidia ...
by nodesocket on Wednesday August 27, 2025 @11:12PM
(#45047944)
I mean the spark is $3,999 and current M3 Max 28-Core CPU 60-Core GPU is the same price. I would expect the refreshed studio will stay around the same price.
Re:A Grace Blackwell AI Supercomputer on Your Desk – Nvidia ...
by KingOfCoders on Thursday August 28, 2025 @12:36AM
(#45048418)
In Germany the 96gb version is 5000 EUR and the 256gb version is 7000 EUR (no 128gb available as far as I can see).
Re:A Grace Blackwell AI Supercomputer on Your Desk – Nvidia ...
by spwa4 on Thursday August 28, 2025 @05:13AM
(#45050068)
At that point it's far superior to fly to the US, buy it, and fly back. Hell, have a nice week in a hotel and bring two.
Re:A Grace Blackwell AI Supercomputer on Your Desk – Nvidia ...
by jweir on Thursday August 28, 2025 @10:42AM
(#45052800)
Fly to a state with no sales tax. Portland, Oregon serves this purpose for high end shoppers that come from out of state and out of the country. Folks fly in to buy their Rolex, Gucci, etc, with no tax.
Re:A Grace Blackwell AI Supercomputer on Your Desk – Nvidia ...
by KingOfCoders on Thursday August 28, 2025 @01:32PM
(#45054804)
Doesn't work with Germany, you'll have to pay VAT at the airport.
Re:A Grace Blackwell AI Supercomputer on Your Desk – Nvidia ...
by nodesocket on Thursday August 28, 2025 @03:50PM
(#45056303)
What are they examining your bags for purchased items? That’s gestapoish.
Re:A Grace Blackwell AI Supercomputer on Your Desk – Nvidia ...
by gunalx on Thursday August 28, 2025 @04:48PM
(#45056861)
not nessesarily, but you'll have an issue if they do a controll, or it comes up.
Re:A Grace Blackwell AI Supercomputer on Your Desk – Nvidia ...
by KingOfCoders on Thursday August 28, 2025 @11:57PM
(#45059997)
1. Yes they will if they suspect you (age group, clothes, newest phone, certain flights like LAX, LGA) as all custom officers all over the world do. As my bags have been searched every time I've entered the US.
2. You should read up on the Gestapo
Re:A Grace Blackwell AI Supercomputer on Your Desk – Nvidia ...
by spwa4 on Friday August 29, 2025 @03:44AM
(#45061317)
US customs won't care if they find new electronics, so they're no problem (they are annoying, with the suitcase thing at port-of-entry, but no problem). As for German customs, I don't know, but: do the initial leave out of Germany over the road where there's checks only in theory and leave from an airport not too far over the border. You can probably get a cheaper flight in the process (e.g. Fly from Basel)
Re:A Grace Blackwell AI Supercomputer on Your Desk – Nvidia ...
by lostlogin on Saturday August 30, 2025 @01:39PM
(#45076514)
The Germans look for electronics, the Americans look in the electronics and what’s on them.
Re:A Grace Blackwell AI Supercomputer on Your Desk – Nvidia ...
by spwa4 on Monday September 01, 2025 @03:33AM
(#45090384)
Fly back through Geneva, and take some basic precautions, such as not taking the box. Done/done.
Re:A Grace Blackwell AI Supercomputer on Your Desk – Nvidia ...
by stefanfisk on Thursday August 28, 2025 @05:31AM
(#45050194)
Are you comparing prices with or without taxes? US usually prices without and EU with.
Re:A Grace Blackwell AI Supercomputer on Your Desk – Nvidia ...
by FirmwareBurner on Thursday August 28, 2025 @02:39AM
(#45049145)
If that would be true why aren't Mac sales banned in China instead of Nvidia GPUs?
Re:A Grace Blackwell AI Supercomputer on Your Desk – Nvidia ...
by saagarjha on Thursday August 28, 2025 @03:19AM
(#45049393)
Those are high end GPUs that aren’t comparable
Re:A Grace Blackwell AI Supercomputer on Your Desk – Nvidia ...
by nevi-me on Thursday August 28, 2025 @02:58AM
(#45049264)
Because Tim bribed Trump with a golden calf, or more seriously it's easier to ban a component and its manufacturer vs broader systems.
Re:A Grace Blackwell AI Supercomputer on Your Desk – Nvidia ...
by actionfromafar on Thursday August 28, 2025 @04:31AM
(#45049825)
Not unprecedented though, Playstation 2 had export restrictions.
But it was a different time. Most policies had some connection to the subject at hand.
Policies today are all about brand Trump and brand MAGA.
Re:A Grace Blackwell AI Supercomputer on Your Desk – Nvidia ...
by nodesocket on Thursday August 28, 2025 @05:33AM
(#45050200)
funny to hear the tards that haven’t listened to any of the policy screeches pretend like they know what’s going on.
Re:A Grace Blackwell AI Supercomputer on Your Desk – Nvidia ...
by int_19h on Friday August 29, 2025 @12:56AM
(#45060363)
Because it's only a superior solution if you just want one box, and that mostly for inference. Once you start scaling to larger loads, it's much trickier to get a clusters of Macs to efficiently process them in parallel, whereas datacenter GPUs are designed for clusters.
Re:A Grace Blackwell AI Supercomputer on Your Desk – Nvidia ...
by thomasskis on Thursday August 28, 2025 @02:50AM
(#45049208)
I run 4 Mac Studio ultras at work (they’re pricy when maxed out), for local-first AI dev services. But there’s a few things that make me want to switch to the Spark. Networking is the biggest one, the Macs have Thunderbolt and Ethernet, but if I run distributed inference with EXO over Thunderbolt; the drop in tokens/second is massive. These Sparks get RDMA and can stack nicely. The other big one is access to CUDA, MLX has come a long way but being able to have CUDA and GPU access in containers would simplify the stack so nicely. If I had a USB-C/Thunderbolt backplane it might compare, but scaling with the Spark is likely a lot more straightforward.
I call the stack with Mac Studios “MacAIver” because it feels like a duct tape solution, but the Spark equivalent would likely be more elegant.
Re:A Grace Blackwell AI Supercomputer on Your Desk – Nvidia ...
by aurareturn on Thursday August 28, 2025 @04:48AM
(#45049916)
You'd have to stack 16 of these to get 2TB of VRAM, equivalent to 4 Mac Studios 512GBs chained together.
16 compared to 4. Surely even much faster networking in the Spark would degrade with that many devices?
Biggest problem with Macs is that they don't have dedicated tensor cores in the GPU which makes prompt processing very slow compared to Nvidia and AMD.
Re:A Grace Blackwell AI Supercomputer on Your Desk – Nvidia ...
by themgt on Thursday August 28, 2025 @05:31AM
(#45050190)
n.b. there's been a little speculation that Apple adding TensorOps to Metal 4 suggests M5/M6 may get tensor cores.
https://x.com/liuliu/status/1932158994698932505
https://developer.apple.com/metal/Metal-Shading-Language-Spe...
Re:A Grace Blackwell AI Supercomputer on Your Desk – Nvidia ...
by aurareturn on Thursday August 28, 2025 @07:23AM
(#45050836)
Nice. I hope so. That would make Macs the best local LLM machines for the masses by far.
Re:A Grace Blackwell AI Supercomputer on Your Desk – Nvidia ...
by thomasskis on Thursday August 28, 2025 @11:00AM
(#45053056)
It’s $12k for each Mac Studio, and the networking makes them only effective individually (it’s like less that 15 tokens/s with EXO) while NVLINK is very effective. The Spark is definitely more scalable, but the MLX and metal teams are cooking, so honestly either way is still winning.