Whisper: Nvidia RTX 4090 vs. M1 Pro with MLX

Re:Whisper: Nvidia RTX 4090 vs. M1 Pro with MLX by mac-mc on Wednesday December 13, 2023 @02:09PM (#38632580)

The "available VRAM" is the big difference. You get a lot more to use on an apple silicon machine for much cheaper than you get on an nvidia card on a $/GB basis, especially if you want to pass the 24GB threshold. You can't use NVIDIA consumer cards after that and there is a shortage of them.

The power:perf ratios seem about equal although, so it's really up to apple to release equivalently sized silicon on their desktop to really have this be a 1:1 comparison.

[ Parent | on HN ]

Re:Whisper: Nvidia RTX 4090 vs. M1 Pro with MLX by swores on Wednesday December 13, 2023 @04:33PM (#38634455)

I wonder how complicated it would be to make happen / how likely it is to happen, for the Apple way of sharing memory between CPU and GPU to become a thing on PCs. Could NVIDIA do it unilaterally or would it need to be in partnership with other companies?

Could anyone who understands this hardware better than me chime in on the complexities of bringing unified ram/vram to PC, or reasons it hasn't happened yet?

[ Parent | on HN ]

Re:Whisper: Nvidia RTX 4090 vs. M1 Pro with MLX by kalleboo on Thursday December 14, 2023 @02:09AM (#38638629)

AMD built "Heterogeneous System Architecture" for their APUs to do the same thing, but since their APUs all ended up mostly targeting cheap/low-power/low-profile laptops and business machines, it was never actually utilized (from what I've been able to find, there's no public API to actually use this as designed and you still have to copy things from "system RAM" to "GPU RAM" even though the hardware was designed to support zero-copy, whereas Apple has made it all automatic when you use Metal)

[ Parent | on HN ]