Re:Whisper: Nvidia RTX 4090 vs. M1 Pro with MLX
by modeless on Wednesday December 13, 2023 @03:03PM
(#38633431)
Yes, H100 would be faster still, and Grace Hopper perhaps even somewhat faster. But Apple doesn't have comparable datacenter-only products, so it's also interesting to see the comparison of consumer hardware. Also, 4090 is cheaper than Apple's best, but H100 is more than both (if you are even allowed to buy it).
Wouldn't the high end for Nvidia be their dedicated gear rather than a 4090?