News for hackers. Stuff that matters.
Re:Nvidia Was in Trouble Before the Jensen Huang Mess by Melatonic on Monday November 16, 2026 @02:36PM (#50521960)
Google has two different types of TPUs now. One for inference and one for training.

Do we actually know they're more efficient per watt or for the power used and heat produced ? Or are they just easier to scale (and manufacturer) en masse ?

There's also the CUDA moat which is hard to get around

Re:Nvidia Was in Trouble Before the Jensen Huang Mess by SwellJoe on Monday November 16, 2026 @04:03PM (#50523240)
[delayed]
Re:Nvidia Was in Trouble Before the Jensen Huang Mess by lhd1 on Monday November 16, 2026 @05:16PM (#50524186)
clearly they did not read the article
Re:Nvidia Was in Trouble Before the Jensen Huang Mess by jordanb on Monday November 16, 2026 @04:26PM (#50523520)
Cuda is a moat for traditional data science, where you have a torch model and you want to easily run it on a GPU. CUDA is the happy path for doing this.

Nvidia's moat for LLMs isn't Cuda, it's installed capacity, arrangements with frontier labs, TSMC bandwith, and just the fact that it currently has no real competition.

Re:Nvidia Was in Trouble Before the Jensen Huang Mess by genxy on Monday November 16, 2026 @05:21PM (#50524244)
And deals with memory manufacturers.
Re:Nvidia Was in Trouble Before the Jensen Huang Mess by yubblegum on Tuesday November 17, 2026 @08:18AM (#50530961)
Various articles recently claimed most of the NVIDIA deals are "handshakes with Jensen".

This Huang scandal has so many dimensions that are clearly more impactful on the world outside than to NVIDIA itself -- the blast radius seems to extend to the US cabinet -- that it begs questions if Jensen Huang wasn't id'd as the essential piece to remove to affect a comprehensive restructing in the segment.

So if deals fall apart because Jensen and his handshake have left the room, that may unclog many memory and processing supply lines that are currently spoken for by deals with Jensen. That may have been a goal from the start.

Re:Nvidia Was in Trouble Before the Jensen Huang Mess by genxy on Tuesday November 17, 2026 @11:15AM (#50533564)
So the GPUs were a cherry on top, the real target was removing Huang? And Jensen huang'd himself by making himself the brittle link in a chain (his handshake deals being a big one).
Re:Nvidia Was in Trouble Before the Jensen Huang Mess by cyberax on Monday November 16, 2026 @05:45PM (#50524557)
CUDA is useful if you want a human expert writing new experimental kernels, perhaps while testing different algorithms.

But once you do that, translating CUDA into one of many available vectorized backends is trivial.

We have a bunch of custom kernels for geometric operations (like merging polygons) and they were rather difficult to write a while ago. AI rewrote them in HIP during my lunch break.

Re:Nvidia Was in Trouble Before the Jensen Huang Mess by MisterMunchkin on Tuesday November 17, 2026 @02:52AM (#50528640)
Quantity has a quality of its own