News for hackers. Stuff that matters.
Re:AMD Now Has More Compute on the Top500 Than Nvidia by pclmulqdq on Monday November 18, 2024 @04:30PM (#42177276)
B200s have an incremental increase in FP64 and FP32 performance over H100s. That is the number format that HPC people care about.

The MI300A can get to 150% the FP64 peak performance that B200 devices can get, although AMD GPUs have historically underperformed their spec more than Nvidia GPUs. It's possible that B200 devices are actually behind for HPC.

Re:AMD Now Has More Compute on the Top500 Than Nvidia by cayleyh on Monday November 18, 2024 @04:37PM (#42177364)
Top line comparison numbers for reference: https://www.theregister.com/2024/03/18/nvidia_turns_up_the_a...

It does seem like Nvidia is prioritizing int8 / fp8 performance over FP64, which given the current state of the ML marketplace is a great idea.

Re:AMD Now Has More Compute on the Top500 Than Nvidia by nextos on Monday November 18, 2024 @06:00PM (#42178086)
MI300 also have decent performance in FP16 (~108 TFLOPS). Not as good as NVIDIA, but it's getting there. Anyone has experience using these on JAX? Support is said to be decent, but no idea if it's good enough for research-oriented tasks, i.e. stable enough for training and inference.