News for hackers. Stuff that matters.
Re:Nvidia Was in Trouble Before the Jensen Huang Mess by bigyabai on Monday November 16, 2026 @12:44PM (#50520410)
TPUs are a systolic array. It's not comparable to the hardware architecture that backstops CUDA, nor do they serve the same markets.

The writing was on the wall for TSMC ever since the 5nm node; Apple proved that anyone with enough liquid cash could block competitors from fab access.

Re:Nvidia Was in Trouble Before the Jensen Huang Mess by simpetre on Monday November 16, 2026 @01:18PM (#50520881)
Modern NVIDIA GPUs contain tensor cores that are optimised for MMA operations as well though right? The standard CUDA execution path isn’t comparable, but the tensor core path very much is?
Re:Nvidia Was in Trouble Before the Jensen Huang Mess by Melatonic on Monday November 16, 2026 @02:46PM (#50522130)
I'm no expert but I think we're dealing with two different ends of the spectrum here. Nvidia GPUs are likely cutting edge within the individual board / processor itself. Their main limiting factor right now seems in effectively networking them together (which is why they bought Mellanox or whatever awhile back to further develop Infiniband).

TPUs are significantly less flexible and I would guess at an individual level not as efficient or fast as Nvidia. But they're designed specifically to be bundled together in large arrays with similarly large data pipes to storage and interconnects to cache, ram and other compute. I would guess Google didn't bother trying to sell them until recently because you needed to be deploying them at large scale for it to be even worth also developing the software for.

What we really need is innovation in super fast (bandwidth and latency) and reliable interconnects. I suspect the days of slotted in GPU and RAM will be over soon and we'll see a move everywhere to pin based sockets (like we've always had for CPUs). Stuff like SXM and LPCAMM