News for hackers. Stuff that matters.
Re:ROCm Is AMD's #1 Priority, Executive Says by mgaunard on Tuesday September 26, 2023 @03:44PM (#37664857)
People have been using their GPGPUs for decades on a variety of scientific applications, and there are all kinds of hybrid and multi-device frameworks that exist (often supporting multiple backends).

The difference is that it didn't get a lot of love as part of the overhyped python LLM movement.

Re:ROCm Is AMD's #1 Priority, Executive Says by gdiamos on Tuesday September 26, 2023 @03:55PM (#37664999)
Completely agree, I'd love to see some of the innovations from HPC move over into their LLM stack.

We are working on it, but it takes time.

Contributions to foundational layers like ROCBlas, pytorch, slurm, Tensile, huggingface, etc would help.