News for hackers. Stuff that matters.
Re:1.5 TB of VRAM on Mac Studio – RDMA over Thunderbolt 5 by lostmsu on Thursday December 18, 2025 @10:53PM (#46322116)
> 3090 would be nice

They would need 3x speedup over the current generation to approach 3090. A100 that has +- the 3090 compute but 80GB VRAM (so fits LLaMA 70B) does prefill at 550tok/s on a single GPU: https://www.reddit.com/r/LocalLLaMA/comments/1ivc6vv/llamacp...

Re:1.5 TB of VRAM on Mac Studio – RDMA over Thunderbolt 5 by doctorpangloss on Friday December 19, 2025 @01:58AM (#46322979)
the GB10 is only the same performance as a 3090. gb10 uses way less power.

i'm not sure why anyone would buy a mac studio instead of a gb10 machine for this use case.

Re:1.5 TB of VRAM on Mac Studio – RDMA over Thunderbolt 5 by villgax on Friday December 19, 2025 @06:14AM (#46324532)
it's just people looking to do experiments locally on the main machine rather than just get a dedicated spark, which can be used properly as a headless box than a Mac of which you are at the mercy of system shenanigans albiet still bearable compared to windows
Re:1.5 TB of VRAM on Mac Studio – RDMA over Thunderbolt 5 by rbanffy on Friday December 19, 2025 @07:46AM (#46325213)
> i'm not sure why anyone would buy a mac studio instead of a gb10

For an AI-only use case, the GB10s make sense, but they are only OK as desktop workstations, and I’m not sure for how long DGX OS will be updated, as dedicated AI machines have somewhat short lives. Apple computers, OTOH, have much longer lives, and desktops live the longest. I retired my Mac Mini a year after the machine was no longer getting OS updates, and it was still going strong.

Re:1.5 TB of VRAM on Mac Studio – RDMA over Thunderbolt 5 by FuriouslyAdrift on Friday December 19, 2025 @01:04PM (#46328877)
DGX OS (based on Ubuntu) is used for all of nVidias GPU compute systems so it's probably going to be around for a while.
Re:1.5 TB of VRAM on Mac Studio – RDMA over Thunderbolt 5 by rbanffy on Friday December 19, 2025 @02:32PM (#46329882)
But how long until hardware support is dropped?
Re:1.5 TB of VRAM on Mac Studio – RDMA over Thunderbolt 5 by FuriouslyAdrift on Friday December 19, 2025 @04:16PM (#46331024)
I don't know... when is nVidia planning on getting out of the ai business?
Re:1.5 TB of VRAM on Mac Studio – RDMA over Thunderbolt 5 by rbanffy on Friday December 19, 2025 @06:29PM (#46332200)
When will they discontinue GB10 hardware support because it’s too slow and they want to sell you newer chips?
Re:1.5 TB of VRAM on Mac Studio – RDMA over Thunderbolt 5 by lostmsu on Sunday December 21, 2025 @11:45AM (#46346095)
Yeah, if you had experience with their Jetson boards, you'd know Nvidia is not well regarded for their OS support.

TK1 support stopped after under 4 years. Basically they released it with some version of Ubuntu (14.04 LTS) and never upgraded it.