News for hackers. Stuff that matters.

A comment on AMD's MI300X Outperforms Nvidia's H100 for LLM Inference. Parent comment

Re:AMD's MI300X Outperforms Nvidia's H100 for LLM Inference by mistymountains on Thursday June 13, 2024 @11:23AM (#40670801)
Unless you develop in CUDA, you can easily train code (e.g. PyTorch) written for training on Nvidia hardware on AMD hardware. You can even keep the .cuda() calls.
[ Parent | on HN ]
Re:AMD's MI300X Outperforms Nvidia's H100 for LLM Inference by sigmoid10 on Thursday June 13, 2024 @12:44PM (#40671840)
In theory. But if you actually work with that in practice, you're already going to have a bad experience installing the drivers. And it's all downhill from there.
[ Parent | on HN ]