News for hackers. Stuff that matters.
Re:AMD's MI300X Outperforms Nvidia's H100 for LLM Inference by mistymountains on Thursday June 13, 2024 @11:21AM (#40670778)
I’m a AI Scientist and train a lot of models. Personally I think AMD is undervalued relative to Nvidia. No, chips aren’t as fast as Nvidia’s latest and yes, there are some hoops to get things working. But for most workloads in most industries (ignoring for the moment that AI is likely a poor use of capital), it will be much more cost effective and achieve about the same results.

There are no comments on this comment yet.