News for hackers. Stuff that matters.
Re:Nvidia's earnings are up 206% from last year as it contin... by LeanderK on Tuesday November 28, 2023 @11:52AM (#38447829)
I don't think you will need something coda-compatible. Apple has relatively solid pytorch support without copying CUDA, but PyTorch+ROCm is still not working on windows (and I think there's no ROCm support for the consumer GPUs from AMD).

I think Apple proves that it is possible, and possible relatively quickly.

Re:Nvidia's earnings are up 206% from last year as it contin... by kimixa on Tuesday November 28, 2023 @01:09PM (#38448887)
Pytorch supports directML on windows - is that not sufficient (or performant) for your usecase? It feels like AMD are less willing to step on Microsoft's toes, possibly as they just don't have the market share clout.

And Rocm supports the higher RDNA2 and the highest-end RDNA3 consumer GPUS - [0], though only the top RNDA3 cards in linux [1] (officially - other cards often do "work" but YMMV)

One thing Nvidia are much better at is supporting the whole stack - while I doubt many people are actually running much ML on 8gb mid-low end cards, it seems a hook for sales if people "could" do that, and a starting point for personal experimentation. I know multiple people who buy low end Nvidia GPUs because they "might" experiment with CUDA some time in the future.

[0] https://rocm.docs.amd.com/en/latest/release/windows_support.... [1] https://rocm.docs.amd.com/en/latest/release/gpu_os_support.h...

Re:Nvidia's earnings are up 206% from last year as it contin... by LeanderK on Thursday November 30, 2023 @02:16PM (#38477823)
> One thing Nvidia are much better at is supporting the whole stack - while I doubt many people are actually running much ML on 8gb mid-low end cards, it seems a hook for sales if people "could" do that, and a starting point for personal experimentation. I know multiple people who buy low end Nvidia GPUs because they "might" experiment with CUDA some time in the future.

but this is very important. Many develop locally before sending it to a cluster, especially if you only have limited credits available.