Re:Linux 6.6 to Protect Against Illicit Behavior of Nvidia P...
by debugnik on Wednesday August 30, 2023 @07:09PM
(#37330317)
AFAIK the vast majority of ML training/inference on the GPU runs on CUDA, and has done so for many years, while other vendor-specific GPU backends are slowly gaining support.
It doesn't help that AMD's equivalent open toolchain, ROCm, is barely even supported by their own GPU lineup.
Re:Linux 6.6 to Protect Against Illicit Behavior of Nvidia P...
by slavik81 on Thursday August 31, 2023 @12:47AM
(#37332584)
FWIW, ROCm GPU support is getting better, particularly in the distro-provided packages. e.g. https://salsa.debian.org/rocm-team/community/team-project/-/...
how is AI stuff tied to nvidia? what would make it difficult to port (or to be portable)?