Making AMD GPUs competitive for LLM inference

Re:Making AMD GPUs competitive for LLM inference by BearOso on Wednesday December 25, 2024 @11:55AM (#42509704)

No high-end consumer RDNA4 GPU this cycle. And it's only missing the very high-end model. So we'll still get at least a 7800xt equivalent and whatever CDNA MI models they come out with.

The market for the extreme high-end consumer is pretty small, so they're only missing out on clout.

[ Parent | on HN ]

Re:Making AMD GPUs competitive for LLM inference by treprinum on Wednesday December 25, 2024 @04:33PM (#42511311)

The top-end RDNA4 GPU will have 16GB RAM. That's a massive regression compared to 7900XTX and performance-wise it should be at best at the 7900XTX level. We are discussing AMD cards for LLM inference where VRAM is arguably the most important aspect of a GPU and AMD just threw in the towel for this cycle.

[ Parent | on HN ]