Re:AMD Wants to Know If You'd Like Ryzen AI Support on Linux
by the_pwner224 on Friday October 20, 2023 @11:00PM
(#37963723)
The AI engines on these chips are derived from the Xilinx AIE / AIE-ML cores. The Xilinx aiecompiler only runs on Linux - which is special because, aside from aiecompiler, basically all of the Xilinx tools work on both Windows and Linux.
In contrast the Ryzen AI stuff is more consumer focused. And 99% of consumers are using Windows. Having Linux support would be nice, but it totally makes sense that they would implement it on Windows first and prioritize that. Linux probably isn't worth it aside from for developer mindshare. And I say this as someone who's been using desktop Linux for over a decade.
Re:AMD Wants to Know If You'd Like Ryzen AI Support on Linux
by brucethemoose2 on Friday October 20, 2023 @10:56PM
(#37963701)
If they have to meekly ask if anyone wants linux support... Usage not going to proliferate anyway.
Getting support from popular projects for Metal, ROCm, Vulkan, Intel's frameworks and Nvidia TensorRT is already like pulling teeth, even with Intel, Apple and Nvidia paying engineers to integrate the already functional frameworks into projects.
Re:AMD Wants to Know If You'd Like Ryzen AI Support on Linux
by mardifoufs on Saturday October 21, 2023 @01:11AM
(#37964271)
It's not like actual AI dev will take place on ryzenai hardware. At best it would be for accelerating current workloads. It's very very... lackluster in terms of performance even for basic inference tasks
Re:AMD Wants to Know If You'd Like Ryzen AI Support on Linux
by mardifoufs on Saturday October 21, 2023 @01:10AM
(#37964264)
I mean, it barely even exists or seems to be acknowledged in Windows either. Somehow, they made it into a feature that OEMs can decide to disable , even with compatible CPUs. You could buy a CPU marketed as having ryzenai without being able to actually use it. This issue (and the complete lack of info, save from the input of a very helpful employee) to me shows the state of ryzenai:
Re:AMD Wants to Know If You'd Like Ryzen AI Support on Linux
by pk-protect-ai on Saturday October 21, 2023 @03:07AM
(#37964741)
If AMD does not improve the quality of their drivers and ML stack, they can kiss the ML market goodbye. I have tended to buy the best hardware per dollar for the last 20 years. Sometimes I have Intel CPUs, sometimes AMD, sometimes both, but I stopped buying AMD GPUs in 2007. I completely switched to Linux from FreeBSD in 2003, and the only viable option for me has always been NVIDIA due to the availability and quality of their drivers. I don't mind AMD losing the ML race, though it is very sad that NVIDIA does not have strong competitors.
Secret deal with Microsoft perhaps?
In contrast the Ryzen AI stuff is more consumer focused. And 99% of consumers are using Windows. Having Linux support would be nice, but it totally makes sense that they would implement it on Windows first and prioritize that. Linux probably isn't worth it aside from for developer mindshare. And I say this as someone who's been using desktop Linux for over a decade.
So my linux VM can run kvm.
Getting support from popular projects for Metal, ROCm, Vulkan, Intel's frameworks and Nvidia TensorRT is already like pulling teeth, even with Intel, Apple and Nvidia paying engineers to integrate the already functional frameworks into projects.
https://github.com/amd/RyzenAI-SW/issues/2
And yes, it’s weird that they have to ask. I thought a significant amount of AI work was done in Linux.
This is not my scientific assessment, but a very strong feel from looking at Github issues, Discord chat and AI Horde hosts.
Even devs for some of the big frameworks seem to be primarily Windows based.
I think the die area for AMD's ASIC is pretty small.
I have some quips about Phoenix, but the tiny AI block with poor software support is very low on the list.
Do they not see the piles of money Nvidia is making? Support for all of the major platforms should be pretty obvious from their position
https://github.com/amd/RyzenAI-SW/issues/5#issuecomment-1726...