News for hackers. Stuff that matters.
Re:HipKittens: Fast and Furious AMD Kernels by 0manrho on Friday November 14, 2025 @07:24PM (#45933833)
> AMD never misses an opportunity to miss an opportunity

Well said, their Instinct parts are actually, at a hardware level, very very capable pieces of kit that - ignoring software/dev ecosystem - are very competitive with NVidia.

Problem is, AMD has a terrible history of supporting it's hardware (either just outright lack of support, cough Radeon VII; or constantly scrapping things and starting over and thus the ecosystem never matured) and is at a massive deficit behind the CUDA ecosystem meaning that a lot of that hardware's potential is squandered by the lack of compatibility with CUDA and/or a lack of investment in comparable alternative. Those factors has given NVidia the momentum it has because most orgs/devs will look at the support/ecosystem delta, and ask themselves why they'd expend the resources reinventing the CUDA wheel to leverage AMD hardware when they can just spend that money/time investing in CUDA and NVidia instead.

To their credit, AMD it seems has learned it's lesson as they're actually trying to invest in ROCm and their Instinct ecosystem and seem to be sticking to their guns on it and we're starting to see people pick it up but they're still far behind Nvidia and CUDA.

One key area that Nvidia is far ahead of AMD on in the hardware space is networking.

Re:HipKittens: Fast and Furious AMD Kernels by BNE on Friday November 14, 2025 @07:54PM (#45934057)
Our hardware is arguably better (spec for spec) apart from critical areas like memory bandwidth, and GPU to GPU bandwidth. You can tweak your implementations to get the same if not better performance. We do that, we see this, our customers see this.

ROCM pre Rock, suffers from the ossification in the engineering organization. The Rock seeks to completely change that, and the team driving it is amazing. Try out the pre-alpha installer. It is already better than the default installer.

There is hope.

Re:HipKittens: Fast and Furious AMD Kernels by AMDAnon on Friday November 14, 2025 @08:02PM (#45934102)
TheRock is phenomenal for AMD but it's obvious Anush Elangovan is gearing up to lay off the legacy ROCm devs.

It's also just a basic cmake monorepo with features like end-to-end testing. Most big tech companies have had that for years.

Re:HipKittens: Fast and Furious AMD Kernels by 0manrho on Friday November 14, 2025 @10:21PM (#45934779)
> There is hope.

Indeed. For clarity, I agree the performance is certainly there. My comment about being behind was in the context of marketshare and ecosystem maturity compared to CUDA. In fact, I'd say there's more than just hope but actual meaningful progress and commitment being made there, and I'm happy to see it.

Re:HipKittens: Fast and Furious AMD Kernels by AMDAnon on Friday November 14, 2025 @07:50PM (#45934027)
> constantly scrapping things and starting over and thus the ecosystem never matured

AMD hires talented people at below-market and doesn't promote them or give raises. This causes employees to aim at resume-driven development by reinventing the wheel so they can get a job somewhere else.

It's a similar problem to Google, except at Google it's because promotions are explicitly for people that ship new products.

Re:HipKittens: Fast and Furious AMD Kernels by ivape on Saturday November 15, 2025 @11:34AM (#45938560)
I wouldn’t even look at it like they are learning their lesson. The total addressable market is 1T according to them, and they are usually very conservative with their approach and projections. They will solve the software issue because there is simply too much money in it.