News for hackers. Stuff that matters.
Re:Nvidia Was in Trouble Before the Jensen Huang Mess by nostrademons on Monday November 16, 2026 @12:13PM (#50519997)
Basically capacity issues. NVidia + Apple have bought up a significant portion of TSMC's manufacturing capacity. The primary supplier for Google's TPUs is Broadcom, with TSMC as a second source, and they're trying to ink contracts with other suppliers like MediaTek, but there're only so many semiconductor fabs in the world and TPUs need a fairly modern process.

Within Google itself the TPUs are definitely preferred for AI workloads, you just can't always get them.

Re:Nvidia Was in Trouble Before the Jensen Huang Mess by joe_the_user on Monday November 16, 2026 @12:36PM (#50520293)
Broadcom isn't a chip foundry so calling it Google's supplier doesn't make sense. TSMC has been the primary manufacturer of TPUs but Google's hoping to use Samsun and Intel also going forward (and these are the only leading edge foundries in the world). Broadcom is co-developer of the chip.
Re:Nvidia Was in Trouble Before the Jensen Huang Mess by verall on Monday November 16, 2026 @12:58PM (#50520605)
[delayed]
Re:Nvidia Was in Trouble Before the Jensen Huang Mess by Melatonic on Monday November 16, 2026 @03:23PM (#50522658)
What node process do they need to be made on ?
Re:Nvidia Was in Trouble Before the Jensen Huang Mess by joe_the_user on Monday November 16, 2026 @04:21PM (#50523472)
I don't know details at this level but I know that TPUs like GPUs need to be made on the most advanced available nodes and TSMC, Samsung and Intel are exactly the only enterprises pursuing those advanced nodes. The reason is that this is

I mean, Google tell me it's TSMC's 3 and 2 mm process - exactly what you'd expect. But you can Google as well as I can.

Re:Nvidia Was in Trouble Before the Jensen Huang Mess by lizknope on Monday November 16, 2026 @05:33PM (#50524415)
https://en.wikipedia.org/wiki/Tensor_Processing_Unit#Product...

You can see the process node table here.

The newer chips are probably 3nm and they are probably developing the next chip in 2nm.

Re:Nvidia Was in Trouble Before the Jensen Huang Mess by basch on Monday November 16, 2026 @12:38PM (#50520310)
Crazy that a company can use a contract to buy up all the supply to build an inferior product that’s less energy efficient and then sell it at a higher price than the purpose built counterpart. Market failure.
Re:Nvidia Was in Trouble Before the Jensen Huang Mess by bigyabai on Monday November 16, 2026 @12:44PM (#50520410)
TPUs are a systolic array. It's not comparable to the hardware architecture that backstops CUDA, nor do they serve the same markets.

The writing was on the wall for TSMC ever since the 5nm node; Apple proved that anyone with enough liquid cash could block competitors from fab access.

Re:Nvidia Was in Trouble Before the Jensen Huang Mess by simpetre on Monday November 16, 2026 @01:18PM (#50520881)
Modern NVIDIA GPUs contain tensor cores that are optimised for MMA operations as well though right? The standard CUDA execution path isn’t comparable, but the tensor core path very much is?
Re:Nvidia Was in Trouble Before the Jensen Huang Mess by Melatonic on Monday November 16, 2026 @02:46PM (#50522130)
I'm no expert but I think we're dealing with two different ends of the spectrum here. Nvidia GPUs are likely cutting edge within the individual board / processor itself. Their main limiting factor right now seems in effectively networking them together (which is why they bought Mellanox or whatever awhile back to further develop Infiniband).

TPUs are significantly less flexible and I would guess at an individual level not as efficient or fast as Nvidia. But they're designed specifically to be bundled together in large arrays with similarly large data pipes to storage and interconnects to cache, ram and other compute. I would guess Google didn't bother trying to sell them until recently because you needed to be deploying them at large scale for it to be even worth also developing the software for.

What we really need is innovation in super fast (bandwidth and latency) and reliable interconnects. I suspect the days of slotted in GPU and RAM will be over soon and we'll see a move everywhere to pin based sockets (like we've always had for CPUs). Stuff like SXM and LPCAMM

Re:Nvidia Was in Trouble Before the Jensen Huang Mess by sjs382 on Monday November 16, 2026 @12:53PM (#50520540)
> Crazy that a company can use a contract to buy up all the supply to build an inferior product that’s less energy efficient and then sell it at a higher price than the purpose built counterpart. Market failure.

They're not buying up "all the supply to build an inferior product". They're buying it up build a different, high-demand product.

Re:Nvidia Was in Trouble Before the Jensen Huang Mess by nostrademons on Monday November 16, 2026 @12:59PM (#50520623)
They're not really the same markets. NVidia is selling chips that AI runs on, Google is selling services that use AI. Google's play is to make better services than the competition can because they control the full infrastructure stack, thus preventing their markets from being commoditized. NVidia's play is to commoditize the AI providers so that the number of services expands rapidly, with NVidia chips powering all of them. Arguably it's Google's strategy that is the market failure, as it's designed to keep competition out, but...

Google's used this strategy a few times before, and it frequently doesn't work out. They kept MapReduce and GFS proprietary so they could build better big-data services than everyone else, but Doug Cutting from Yahoo clean-roomed it, and then eventually you had interviewees going "MapReduce? That's like Hadoop, right?" They had a long string of internal ML frameworks well before the rest of the industry (I remember in the '00s and early '10s Google was by far the leader in large-scale machine-learning) but had to open-source TensorFlow in the face of external competition, and then lost in the marketplace to PyTorch because TensorFlow was filled with internal WTFs and footguns needed to support specific Google projects. They had a big lead in datacenter technology over everyone else in the industry in the early 2010s, but kept it internal and proprietary until they were forced to sell it as a service by the huge growth of AWS and Azure, then had to play catch-up as a distant 3rd because they lacked the customer relationships and developer mindshare.

Re:Nvidia Was in Trouble Before the Jensen Huang Mess by overfeed on Monday November 16, 2026 @01:34PM (#50521080)
> They're not really the same markets.

Both are fabless customers of TSMC, which happens to be the choke point.

Unlike gp, I do not believe its a market failures as much as the cutting-edge process node bieng a natural monopoly. Once TSMC processes got really good, TSMC started capturing most of revenue dollars and reinvesting them, which made TSMC products even better - a situation that makes it impossible for Samsung or Texas Instruments to catch up. Intel rode on a similar wave for decades

Re:Nvidia Was in Trouble Before the Jensen Huang Mess by FuriouslyAdrift on Monday November 16, 2026 @01:58PM (#50521436)
Packaging is the choke point in AI. It's still TSMC but chip production is doing fine. It's the Chip-on-Wafer-on-Substrate build chain that is severly constrained.

https://www.insidedeeptech.com/tsmc-cowos-packaging-full-gui...

Re:Nvidia Was in Trouble Before the Jensen Huang Mess by Melatonic on Monday November 16, 2026 @02:39PM (#50522013)
Why is no one going to Intel then for this kind of stuff ? Or even a legacy producer like IBM or Ti ? I would imagine they could buy some slightly older ASML litho machines and make something on a slightly older process (or package it using the older process for the other stuff and just keep the main processor latest gen) ?
Re:Nvidia Was in Trouble Before the Jensen Huang Mess by rubyn00bie on Monday November 16, 2026 @04:14PM (#50523370)
From what I’ve read it’s that TSMC is just so much better at it… much higher yields and much more reliable than any of the other fabs. I wanna say something like 2-3 years ago, before Blackwell, NVidia tried to use Samsung for example but had nothing but issues. Intel hasn’t proven its fabs capable of anything really useful in nearly a decade.

I think even if you have the capital to acquire something from ASML… by the time it’s setup and tuned correctly TSMC will likely have enough capacity to eat your lunch. If it takes 2-3 years to get a fab online TSMC will likely have a new node and their old ones will be available.

TSMC has really proven over the past 5-10 years that the fab is its own beast and requires its own immense level of expertise and investment. When you have the worlds largest chip companies shoveling all their manufacturing dollars through one single org, that seemingly does the right thing, it’s going to be pretty much impossible to beat them.

Re:Nvidia Was in Trouble Before the Jensen Huang Mess by Kirby64 on Monday November 16, 2026 @06:35PM (#50525165)
> Why is no one going to Intel then for this kind of stuff ? Or even a legacy producer like IBM or Ti ? I would imagine they could buy some slightly older ASML litho machines and make something on a slightly older process

Literally TI even uses TSMC for the digital only stuff they do. The investment for these cutting edge nodes (or even, not so cutting edge. Like say, 10nm) is absurd vs the payoff.

Re:Nvidia Was in Trouble Before the Jensen Huang Mess by froonly on Monday November 16, 2026 @02:04PM (#50521516)
By the time Hadoop came out, Google had already moved on to Big Table.
Re:Nvidia Was in Trouble Before the Jensen Huang Mess by nostrademons on Monday November 16, 2026 @03:36PM (#50522883)
BigTable and MapReduce are differennt use-cases. The former is a database; the latter is a framework for running batch jobs. The (internal) successor to MapReduce is Flume (2010), which is quite a bit more capable, but didn't come out until Hadoop was already well-established. The external equivalent is Apache Spark (2009), but the gap between internal and external technologies had already shrunk to be nearly indistinguishable by then.
Re:Nvidia Was in Trouble Before the Jensen Huang Mess by joe_the_user on Monday November 16, 2026 @03:38PM (#50522909)
It's logical that company like TSMC sells capacity to the highest bidder.

The main thing is that chip manufacturing is the most highly capitalized industry in the world. Each manufacturing step has gargantuan costs and so no company wants to manage (and pay for) all the steps - so TSMC buys chip manufacturing equipment from ASML and sets up a system where corporations buy capacity. It's essentially a very, very, very expensive print shop. The print shop doesn't make its own printers nor it print a newspaper.

And naturally, with very, very objects like leading-edge chips, "inferior" or "superior" is a ridiculous simplification. Nvidia chips are incredibly powerful and useful. Nvidia has been more committed than any other company to general purpose GPU programming.

But Nvidia also is doing it's best to sell at high, monopoly prices. That's why they buy a lot of capacity. The thing about the situation is these companies did spend a lot of money reaching this monopoly situation so from their viewpoint, this monopoly pricing might be fair. But I personally wouldn't care and hope some regulation stops it. But that kind of regulation would still have to get these companies significant profit on these investments, so they'd keep making them.

Re:Nvidia Was in Trouble Before the Jensen Huang Mess by ulfw on Monday November 16, 2026 @08:37PM (#50526287)
How is it crazy?

If I come to a coffee supplier and say I can pay 50$ for a sack of coffee but I don't know how many I can buy yet as I am building up my coffee shops around the country and then Starbucks comes in and says we are willing to pay 55$ and pay ALL your capacity guaranteed, today, just sign here.

Where do you think most coffee sellers would sign?

Re:Nvidia Was in Trouble Before the Jensen Huang Mess by unparagoned on Tuesday November 17, 2026 @11:25AM (#50533753)
I can’t tell if you are being sarcastic, but that’s not happening
Re:Nvidia Was in Trouble Before the Jensen Huang Mess by Melatonic on Monday November 16, 2026 @02:37PM (#50521982)
Interesting. What manufacturing process is Broadcom producing them at ? I'm guessing they're not newly as small (lithography wise) as the best of the best yet but probably good enough
Re:Nvidia Was in Trouble Before the Jensen Huang Mess by rubyn00bie on Monday November 16, 2026 @04:17PM (#50523424)
Broadcom is just a chip designer or “mercenary” as I read the other day. TSMC is still the fab for most of the TPU, with Mediatek, and Intel used for auxiliary/supporting components.
Re:Nvidia Was in Trouble Before the Jensen Huang Mess by redwood on Monday November 16, 2026 @04:21PM (#50523474)
Broadcom is fabless I believe and therefore competing for that same TSMC space
Re:Nvidia Was in Trouble Before the Jensen Huang Mess by lizknope on Monday November 16, 2026 @05:31PM (#50524390)
> The primary supplier for Google's TPUs is Broadcom, with TSMC as a second source

You've got it all mixed up.

Google designs the TPU in partnership with Broadcom. Many companies will write the Verilog RTL and then send this to another company like Broadcom to do the physical design and turn the Verilog along with lots of other IP blocks like serdes into GDS mask data.

Broadcom does not have any fabs. They send that GDS mask data to TSMC to manufacture the chip just like Nvidia, Apple, and tons of other companies.

I'm a physical design engineer if you have any questions.