News for hackers. Stuff that matters.
Re:AMD to buy Silo AI for $665M by btown on Wednesday July 10, 2024 @11:50AM (#40928242)
The underinvestment in, and abandonment of, a project for a CUDA compatibility layer https://github.com/vosen/ZLUDA?tab=readme-ov-file#faq by AMD a few months ago hints that they no longer see CUDA compatibility as a goal. Perhaps they see Silo as a way to jumpstart bringing ROCm to parity with CUDA's toolkit. It's hard to understand if there's an underlying strategy to how they'll stay relevant from a software perspective when they're abandoning projects like this.

Discussion: https://news.ycombinator.com/item?id=39344815

Re:AMD to buy Silo AI for $665M by seunosewa on Wednesday July 10, 2024 @12:04PM (#40928378)
That's an unfortunate choice. AMD has excelled in making compatible hardware. Not so much software success, if any.
Re:AMD to buy Silo AI for $665M by Narhem on Wednesday July 10, 2024 @07:23PM (#40932448)
CUDA is a decided abstraction with OpenCL I wouldn’t be surprised if eventually they pick a different abstraction to describe the interface they use for writing programs
Re:AMD to buy Silo AI for $665M by Narhem on Wednesday July 10, 2024 @07:25PM (#40932461)
It takes a lot of design skill to make something complex simple. I have a lot of doubt AMDs department even has design skills.
Re:AMD to buy Silo AI for $665M by IshKebab on Wednesday July 10, 2024 @02:49PM (#40930099)
It makes no business sense for them to try to get CUDA compatibility. That would just cement CUDA as the de facto standard, at which point they are locked in to playing catch up forever as nVidia intentionally adds features to break compatibility.

Much more sensible to work on getting rock solid support for their own standards into all the major ML platforms/libraries.

Re:AMD to buy Silo AI for $665M by joe_the_user on Wednesday July 10, 2024 @03:29PM (#40930550)
It depends what means by "business sense". Compatible makers have profited, did profit during PC era. Indeed, one of AMD's core businesses is make xx86 compatible CPUs.

Nvidia and standard-maker is limited in what breaking changes they introduce - these can harm their customers as much as they harm the competition. Intel failed to force all their changes on AMD as the xxx86 market expanded (notably, the current iteration of CPUs standards was set by AMD after Intel was unable to sell their completely new standard).

Still, I'd acknowledge that "business sense" today follows the approach of only aiming for markets the company can completely control and by that measure, CUDA compatibility isn't desirable.

Re:AMD to buy Silo AI for $665M by mandevil on Wednesday July 10, 2024 @04:48PM (#40931335)
I think the key is that CUDA is much more like the Microsoft Windows software part of the duopoly than the Intel x86 hardware part of the old Wintel duopoly. At best back in the glory days of that era, you could have weird hackish things like WINE ... until Microsoft's business model changed and started being interested in supporting virtualization to build up Azure.

The key is that while there were many clones of x86, there never really was an attempt at a company built around "run MS Windows programs natively" because maintaining software compatability is an order of magnitude harder than doing it for hardware.

Re:AMD to buy Silo AI for $665M by joe_the_user on Thursday July 11, 2024 @12:15AM (#40933650)
CUDA is absolutely not equivalent to Windows as a platform. It's essentially a single API, not a huge, multilayer and futzy platform with multiple weirdly behaved APIs.

Moreover, companies aren't buying GPUs to keep their huge stable of legacy applications running. They want to create new AI applications and CUDA is a simple API for doing that (at a certain level).

Re:AMD to buy Silo AI for $665M by mandevil on Thursday July 11, 2024 @01:58AM (#40934017)
CUDA is a programming language with libraries (cuBLAS, cuSPARSE, etc.) that are constantly having things added and try to maintain backwards compatibility. It's not as big and hefty as all of Win32 sure, but it's still far more difficult than x86 compatibility.
Re:AMD to buy Silo AI for $665M by joe_the_user on Thursday July 11, 2024 @03:19PM (#40939692)
Those libraries are written CUDA. Windows has had a multitude of APIs and layers (DOS, WIN32, etc) none of which were written in an underlying language/api.

Microsoft's entire history is around building a moat of APIs because the PC software industries has a wide variety. Nvidia has, so far, been focused on building actually useful things for developers. Basically, where all the other manufacturers viewed their chips as special purpose devices, Nvidia allowed developers to treat their chips as generic parallel processors and this facilitated the current AI revolution/bubble. Now that Nvidia has created this market, it can charge by the use rather than charging by processing power. The thing is that Nvidia's large potential competitors simply don't want to create clones even if they could - because clones would have to be sold by processing power rather than with a markup for their usefulness. It's worth looking at the list of x86 compatible makers [1]. Making an x86 wasn't quite something you could do in your garage but clearly the barriers to entry weren't huge. But any Nvidia compatible is going to cost a large amount of capital but can only sell by processor power and so AMD, Intel and similar sized entities don't have an interest in doing this.

[1] https://en.wikipedia.org/wiki/List_of_x86_manufacturers

[1] https://en.wikipedia.org/wiki/List_of_x86_manufacturers

Re:AMD to buy Silo AI for $665M by slashdave on Wednesday July 10, 2024 @05:30PM (#40931687)
They don't need parity. They just need ROCm (or OpenCL) to be a reasonably viable alternative.