It's baffling that AMD is the same company that makes both Ryzen and Radeon, but the year-to-date for Radeon has been very good, aside from the official ROCm support for RDNA4 taking far too long. I wouldn't get overly optimistic; even if AMD finally committed hard to ROCm and Radeon it doesn't mean they'll be able to compete effectively against NVIDIA, but the consumer showing wasn't so bad so far with the 9070 XT and FSR4, so I'm cautiously optimistic they've decided to try to miss some opportunities to miss opportunities. Let's see how long these promises last... Maybe longer than a Threadripper socket, if we're lucky :)
I dunno; I suppose they can execute on server parts. But regardless, a good plan here is to let someone else go first and report back.
This is why it’s so important AMD gets their act together quickly, as the benefits of these kind of things are measured in years, not months.
Flash Attention: academia, 2y behind for AMD support
bitsandbytes: academia, 2y behind for AMD support
Marlin: academia, no AMD support
FlashInfer: acadedmia/startup, no AMD
ThunderKittens: academia, no AMD support
DeepGEMM, DeepEP, FlashMLA: ofc, nothing from China supports AMD
Without the long tail AMD will continue to always be in a position where they have to scramble to try to add second tier support years later themselves, while Nvidia continues to get all the latest and greatest for free.
This is just off the top of my head on the LLM side where I'm focused on, btw. Whenever I look at image/video it's even more grim.
I mean of they want to stay at a fraction of the market value and profit of their direct competitor, good for them.
It's Nvidia, AMD, and maybe Intel.
Heck I’ve been able to work through the early chapters of the FastAI book using a lowly Quadro p1000
"25 complimentary GPU hours (approximately $50 US of credit for a single MI300X GPU instance), available for 10 days. If you need additional hours, we've made it easy to request additional credits."
They should care about the availability of their hardware so large customers don't have to find and fix their bugs. Let consumers do that...
Makes it a little hard to develop for without consumer GPU support...
Different architectures was probably a big reason for the above issue.
AMD is a marketing company now
You mean Ryan Smith of late AnandTech fame?
AMD deserves exactly zero of the credulity this writer heaps onto them. They just spent four months not supporting their rdna4 lineup in rocm after launch. AMD is functionally capable of day120 support. None of the benchmarks disambiguated where the performance is coming from. 100% they are lying on some level, representing their fp4 performance against fp 8/16.