News for hackers. Stuff that matters.
Re:New Huawei 96GB GPU by trasirinc on Saturday August 30, 2025 @07:32PM (#45078944)
It's considerably slower than RTX 4090, doesn't have CUDA, and you are entirely beholden to whatever sketchy drivers they have. And power consumption is generally also dog shit.

There are YouTubers who have bought other cards to test them out, and drivers are generally the big problem.

Chinese hardware manufacturers usually only target and test on the hardware/software configs available in China. They mostly use the same stuff, but with weird quirks due to Chinese ownership and modification of a lot of stuff that enters their country.

Re:New Huawei 96GB GPU by diggan on Saturday August 30, 2025 @07:53PM (#45079066)
Interesting approach of taking 2-3 comments from reddit and posting a comment joining them together here, with a brand new account no less. https://old.reddit.com/r/LocalLLaMA/comments/1n46ify/finally...
Re:New Huawei 96GB GPU by nsxwolf on Saturday August 30, 2025 @08:03PM (#45079113)
That is creepy and I do not like it.
Re:New Huawei 96GB GPU by nntwozz on Saturday August 30, 2025 @08:09PM (#45079149)
Feels kinda like AI?
Re:New Huawei 96GB GPU by eric__cartman on Saturday August 30, 2025 @08:00PM (#45079100)
You can't seriously expect a new GPU manufacturer to create a perfectly useable ecosystem on day one.

The drivers will surely get better over time and support for integrating the compute stack that they use will come if the incentive is good enough.

I really hope this doesn't turn out like HIP in AMD Radeon cards. That is absolute dog shit and has been dog shit for ages. It's really sad that an AMD card from 2017 is useless for compute while an equivalent Nvidia card from the same era is just now getting dropped by the latest CUDA versions.

Re:New Huawei 96GB GPU by echelon on Saturday August 30, 2025 @07:45PM (#45079018)
Maybe the Chinese can break the CUDA monopoly?

They're the ones writing most of the open source AI code.

Re:New Huawei 96GB GPU by trasirinc on Saturday August 30, 2025 @07:51PM (#45079052)
Because it's not just "CUDA" by itself, it's the whole ecosystem.

Most AI developers don't actually use CUDA directly, they use programming libraries like PyTorch that use CUDA under the hood to communicate with the GPU to run tasks in parallel.

CUDA is pretty much the standard and is supported anywhere it's relevant.

Just creating an alternative is pretty meaningless if it isn't actually supported anywhere.

Adding support isn't easy, and there's also stability issues, bugs, etc. People want something that works and is reliable (= CUDA, since it's battle-tested).

That's the same flawed argument that people have used to expect Huawei to replace Android/EUV.

Re:New Huawei 96GB GPU by xadhominemx on Saturday August 30, 2025 @07:52PM (#45079061)
Extremely large and fragmented community of AI researchers and developers in China. CUDA competitors in China face the same hurdles as those in the West.