News for hackers. Stuff that matters.
Re:1.5 TB of VRAM on Mac Studio – RDMA over Thunderbolt 5 by erik on Friday December 19, 2025 @12:59AM (#46322690)
The Mac Studio, in some ways, is in a class of its own for LLM inference. I think this is Apple leaning into that. They didn't add RDMA for general server clustering usefulness. They added it so you can put 4 Studios together in an LLM inferencing cluster exactly as demonstrated in the article.

There are no comments on this comment yet.