News for hackers. Stuff that matters.
Re:Was my $48K GPU server worth it? by mountainriver on Thursday May 21, 2026 @04:58PM (#48228804)
Running LLMs on Macs is still terribly slow. They simply lack the optimizations other platforms have.

An RTX 6000 pro Blackwell is a pretty good card

Re:Was my $48K GPU server worth it? by speedgoose on Thursday May 21, 2026 @05:04PM (#48228880)
A M3 ultra mac Studio can run models that do not fit in similarly priced computers with multiple Nvidia GPUs. And it will use a lot less electricity while still having good enough performance. Except the pre-filing perfs that are quite poor on the M3.
Re:Was my $48K GPU server worth it? by ttoinou on Thursday May 21, 2026 @06:10PM (#48229440)
M5 pro 48GB should be good and future proof
Re:Was my $48K GPU server worth it? by thefounder on Thursday May 21, 2026 @06:51PM (#48229788)
If you buy Mac get at least 256GB ram otherwise just buy a bunch of nvidia cards. It really does not make sense otherwise if you are looking for performance / $. The mac (studio) is unique as it has more ram than the alternatives(I.e consumer nvidia cards or spark stuff) so it can fit bigger models but otherwise its performance is worse.
Re:Was my $48K GPU server worth it? by ttoinou on Saturday May 23, 2026 @06:08PM (#48252055)
I’d rather use a 128GB mac which is super flexible than always configuring a desktop with a huge GPU.

Unless you’re doing others things with that gpu such as gaming, video, video AI etc.

Re:Was my $48K GPU server worth it? by plutokras on Saturday May 23, 2026 @04:25PM (#48251123)
Last time I looked into it, I realized how severely it's limited by memory bandwidth. Only the M5 Ultra compares to a dedicated graphics card, but it still falls short.
Re:Was my $48K GPU server worth it? by ttoinou on Saturday May 23, 2026 @06:07PM (#48252048)
M5 Pro is not that expensive and allows for model below 35GB to be used which is a lot of models. And has a boost with neural engines, its not just the memory bandwidth that makes the speed