2023 was the year that GPUs stood still

Re:2023 was the year that GPUs stood still by nemothekid on Friday December 29, 2023 @01:30PM (#38808459)

OpenCL did exist 10 years ago! Rocm has been around for 7 years. Pytorch is 7 years old and had CUDA support on day one and still doesn't have RocM support. Before the LLM craze people still wanted an alternative to nvidia and could see the writing on the wall. There was a bunch of complaining about Rocm and OpenCL didn't deliver. GeoHotz tried to get a RocM backend working and the examples just didn't work.

You can't build a software platform by just willing it into existence. It means sitting down with developers, writing documentation and support users. It means tackling use cases other than llama so that users feel confident in building the next greatest thing on your platform. At it is today, AMD will always be playing catch up and people will continue to push nvidia because the latest and greatest will be on Cuda.

I guess for those of spending money on real gpus for the last 10 years, nvidia was incentivized to take our money but amd wasn't.

[ Parent | on HN ]

Re:2023 was the year that GPUs stood still by latchkey on Friday December 29, 2023 @01:36PM (#38808532)

Before the current crazy of AI, what else generated large sums of money for GPUs?

Games, rendering and crypto.

If I was a hardware company, that's all that I would have focused on. Certainly AMD could have done better on the software/developer front, nobody is arguing that.

I tend to live in the present and what matters is what they are saying and doing today. You can choose to be pissed off about the past, or you can work towards the future.

[ Parent | on HN ]