Re:AMD Wants to Know If You'd Like Ryzen AI Support on Linux
by brucethemoose2 on Friday October 20, 2023 @11:03PM
(#37963730)
The bulk of local Stable Diffusion and Llama usage seems to be on Windows.
This is not my scientific assessment, but a very strong feel from looking at Github issues, Discord chat and AI Horde hosts.
Even devs for some of the big frameworks seem to be primarily Windows based.
Re:AMD Wants to Know If You'd Like Ryzen AI Support on Linux
by mardifoufs on Saturday October 21, 2023 @01:11AM
(#37964271)
It's not like actual AI dev will take place on ryzenai hardware. At best it would be for accelerating current workloads. It's very very... lackluster in terms of performance even for basic inference tasks
Re:AMD Wants to Know If You'd Like Ryzen AI Support on Linux
by pritambaral on Saturday October 21, 2023 @10:07AM
(#37966883)
Better yet, +1 the comment by the AMD employee who specifically asked for it: https://github.com/amd/RyzenAI-SW/issues/2#issuecomment-1773...
https://github.com/amd/RyzenAI-SW/issues/2
And yes, it’s weird that they have to ask. I thought a significant amount of AI work was done in Linux.