No. Per Jeff dean.
Within Google itself the TPUs are definitely preferred for AI workloads, you just can't always get them.
I mean, Google tell me it's TSMC's 3 and 2 mm process - exactly what you'd expect. But you can Google as well as I can.
You can see the process node table here.
The newer chips are probably 3nm and they are probably developing the next chip in 2nm.
The writing was on the wall for TSMC ever since the 5nm node; Apple proved that anyone with enough liquid cash could block competitors from fab access.
TPUs are significantly less flexible and I would guess at an individual level not as efficient or fast as Nvidia. But they're designed specifically to be bundled together in large arrays with similarly large data pipes to storage and interconnects to cache, ram and other compute. I would guess Google didn't bother trying to sell them until recently because you needed to be deploying them at large scale for it to be even worth also developing the software for.
What we really need is innovation in super fast (bandwidth and latency) and reliable interconnects. I suspect the days of slotted in GPU and RAM will be over soon and we'll see a move everywhere to pin based sockets (like we've always had for CPUs). Stuff like SXM and LPCAMM
They're not buying up "all the supply to build an inferior product". They're buying it up build a different, high-demand product.
Google's used this strategy a few times before, and it frequently doesn't work out. They kept MapReduce and GFS proprietary so they could build better big-data services than everyone else, but Doug Cutting from Yahoo clean-roomed it, and then eventually you had interviewees going "MapReduce? That's like Hadoop, right?" They had a long string of internal ML frameworks well before the rest of the industry (I remember in the '00s and early '10s Google was by far the leader in large-scale machine-learning) but had to open-source TensorFlow in the face of external competition, and then lost in the marketplace to PyTorch because TensorFlow was filled with internal WTFs and footguns needed to support specific Google projects. They had a big lead in datacenter technology over everyone else in the industry in the early 2010s, but kept it internal and proprietary until they were forced to sell it as a service by the huge growth of AWS and Azure, then had to play catch-up as a distant 3rd because they lacked the customer relationships and developer mindshare.
Both are fabless customers of TSMC, which happens to be the choke point.
Unlike gp, I do not believe its a market failures as much as the cutting-edge process node bieng a natural monopoly. Once TSMC processes got really good, TSMC started capturing most of revenue dollars and reinvesting them, which made TSMC products even better - a situation that makes it impossible for Samsung or Texas Instruments to catch up. Intel rode on a similar wave for decades
https://www.insidedeeptech.com/tsmc-cowos-packaging-full-gui...
I think even if you have the capital to acquire something from ASML… by the time it’s setup and tuned correctly TSMC will likely have enough capacity to eat your lunch. If it takes 2-3 years to get a fab online TSMC will likely have a new node and their old ones will be available.
TSMC has really proven over the past 5-10 years that the fab is its own beast and requires its own immense level of expertise and investment. When you have the worlds largest chip companies shoveling all their manufacturing dollars through one single org, that seemingly does the right thing, it’s going to be pretty much impossible to beat them.
Literally TI even uses TSMC for the digital only stuff they do. The investment for these cutting edge nodes (or even, not so cutting edge. Like say, 10nm) is absurd vs the payoff.
The main thing is that chip manufacturing is the most highly capitalized industry in the world. Each manufacturing step has gargantuan costs and so no company wants to manage (and pay for) all the steps - so TSMC buys chip manufacturing equipment from ASML and sets up a system where corporations buy capacity. It's essentially a very, very, very expensive print shop. The print shop doesn't make its own printers nor it print a newspaper.
And naturally, with very, very objects like leading-edge chips, "inferior" or "superior" is a ridiculous simplification. Nvidia chips are incredibly powerful and useful. Nvidia has been more committed than any other company to general purpose GPU programming.
But Nvidia also is doing it's best to sell at high, monopoly prices. That's why they buy a lot of capacity. The thing about the situation is these companies did spend a lot of money reaching this monopoly situation so from their viewpoint, this monopoly pricing might be fair. But I personally wouldn't care and hope some regulation stops it. But that kind of regulation would still have to get these companies significant profit on these investments, so they'd keep making them.
If I come to a coffee supplier and say I can pay 50$ for a sack of coffee but I don't know how many I can buy yet as I am building up my coffee shops around the country and then Starbucks comes in and says we are willing to pay 55$ and pay ALL your capacity guaranteed, today, just sign here.
Where do you think most coffee sellers would sign?
You've got it all mixed up.
Google designs the TPU in partnership with Broadcom. Many companies will write the Verilog RTL and then send this to another company like Broadcom to do the physical design and turn the Verilog along with lots of other IP blocks like serdes into GDS mask data.
Broadcom does not have any fabs. They send that GDS mask data to TSMC to manufacture the chip just like Nvidia, Apple, and tons of other companies.
I'm a physical design engineer if you have any questions.