News for hackers. Stuff that matters.
Re:Microsoft introduces its own chips for AI, with eye on cost by scarface_74 on Wednesday November 15, 2023 @03:26PM (#38281968)
If they “can’t make the chips fast enough” being TSMC’s second highest volume customer behind Apple and probably second in priority, what chance does Microsoft have getting enough of TSMCs capacity?
Re:Microsoft introduces its own chips for AI, with eye on cost by donatzsky on Wednesday November 15, 2023 @03:45PM (#38282201)
Microsoft does have the benefit of not having any customers other than themselves, so volumes are smaller.
Re:Microsoft introduces its own chips for AI, with eye on cost by tambre on Wednesday November 15, 2023 @04:09PM (#38282526)
They're more constrained by advanced packaging (CoWoS) capacity rather than the manufacturing of the silicon.
Re:Microsoft introduces its own chips for AI, with eye on cost by tyfighter on Wednesday November 15, 2023 @04:27PM (#38282753)
But from the pictures, the Maia 100 is also using CoWoS packaging. That will be necessary for any new HBM chip.
Re:Microsoft introduces its own chips for AI, with eye on cost by localhost on Wednesday November 15, 2023 @08:13PM (#38284722)
The latest Stratechery interview had Pat Gelsinger on it and he was talking about how Intel is happy to package up TSMC dies in their foundries. Relevant quote:

> So it really brings together many of the things that Intel is doing as an IDM, now bringing it together in a heterogeneous environment where we’re taking TSMC dies. We’re going to be using other foundries in the industry, we’re standardizing that with UCIe. So I really see ourself as the front end of this multi-chip chiplet world doing so in the Intel way, standardizing it for the industry’s participation with UCIE, and then just winning a better technology.

Re:Microsoft introduces its own chips for AI, with eye on cost by tw04 on Wednesday November 15, 2023 @06:05PM (#38283797)
> what chance does Microsoft have getting enough of TSMCs capacity?

Looking at their balance sheet: plenty.

TSMC is all about pay to play. Apple is first in line because they’re willing to pay to be first in line. I have no doubt Microsoft can justify spending the money they save not buying nvidia into getting some priority access from TSMC.

Also keep in mind Apple is now on 3nm so there’s likely spare 5nm.

Re:Microsoft introduces its own chips for AI, with eye on cost by fragmede on Wednesday November 15, 2023 @06:37PM (#38283951)
In exchange for paying to build out TSMC's 3mm capacity, Apple gets exclusive rights to use it for the next N years. Who knows what other exclusivity deals or other shenanigans are in place that would prevent Microsoft from acquiring capacity?
Re:Microsoft introduces its own chips for AI, with eye on cost by sargun on Wednesday November 15, 2023 @07:28PM (#38284364)
My guess is that Microsoft booked capacity years ago. Either by strategic decision, with the belief they could yield the capacity to someone else, or through their other hardware divisions (see: Xbox).

It’s very likely they knew something like this was coming, as they’ve been doing FPGAs for more than a decade now.

Re:Microsoft introduces its own chips for AI, with eye on cost by StevePerkins on Wednesday November 15, 2023 @06:49PM (#38284050)
It blows my mind that not only are Apple, Nvidia, and all other enormous "chip makers" fabless... but there's ONE single company actually making the majority of all their chips.

Why aren't any other companies entering this space? TSMC's growth and profits are immense, it's not like the market couldn't bear more competitors.

Also, the current situation is geopolitical insanity. It feels like China and the U.S. are on a path to war in the next decade or so. China is itching to retake Taiwan... and if you thought the U.S. fought a lot of wars over oil, there's NO WAY we wouldn't go to war to prevent all the world's most important semiconductors falling exclusively under PROC control. It's the 21st century, we would have no choice. I know that TSMC is diversifying and building fabs in the U.S. and Germany, and hopefully that will reduce the risk of war. But it's just nuts that this is even a risk. How does one company control so much of the global market?

Re:Microsoft introduces its own chips for AI, with eye on cost by buildbot on Wednesday November 15, 2023 @07:26PM (#38284355)
TSMC is solving some of the hardest physics, electrical engineering, mechanical engineering, and other kinds of engineering I don't even know about. It's unlikely anyone catches up to them in terms of lithography ability for a long, long time given how well they've executed 45nm and lower nodes.
Re:Microsoft introduces its own chips for AI, with eye on cost by Flameancer on Wednesday November 15, 2023 @08:25PM (#38284822)
More like ASML is solving the physics problems and TSMC is the one with the most capital and experience to run their EUV machines. It’s not that other competitors don’t exist, it’s more like they’ve given up or can’t keep up. Global foundations I believe isn’t making the investment past 16nm. Samsungs latest node doesn’t perform as good as TSMC and intel is being intel.
Re:Microsoft introduces its own chips for AI, with eye on cost by aleph_minus_one on Wednesday November 15, 2023 @10:27PM (#38285554)
> Global foundations I believe isn’t making the investment past 16nm.

GlobalFoundries' Fab 1 can do 1 nm, and its Fab 8 is capable of doing 14 nm:

> https://en.wikipedia.org/w/index.php?title=GlobalFoundries&o...

Re:Microsoft introduces its own chips for AI, with eye on cost by tedunangst on Thursday November 16, 2023 @12:38AM (#38286129)
1 nm is very impressive.
Re:Microsoft introduces its own chips for AI, with eye on cost by aleph_minus_one on Thursday November 16, 2023 @08:27AM (#38289242)
I meant 12 nm. Sorry for the typo. :-(
Re:Microsoft introduces its own chips for AI, with eye on cost by bri3d on Wednesday November 15, 2023 @10:40PM (#38285618)
No. I don’t know where this oft-repeated semiconductor meme came from, but it’s a really poor take.

ASML are solving a small subset of physics problems: how to project extremely small features. TSMC are solving many more physics problems: how to structure layers of doped silicon into transistors, how to structure those transistors into logic gates, and those logic gates into functional blocks. This is why silicon process is not just a matter of capital investment, and why nobody is going to show up overnight with 10 billion dollars and change things. It’s not that TSMC are the only ones with a big bag of cash to give ASML.

Re:Microsoft introduces its own chips for AI, with eye on cost by buildbot on Thursday November 16, 2023 @12:00AM (#38285942)
Yeah I love how people thinks it's easy to mass produce designs that take hundreds of individual steps and weeks for a single wafer to go through the process. 50+ Layers, aligned at the (sub?) nanometer level. Trying to tweak the process so that your electrons stop quantum tunneling across layers in all directions.
Re:Microsoft introduces its own chips for AI, with eye on cost by jasonwatkinspdx on Thursday November 16, 2023 @01:35AM (#38286381)
A fab is far, far, more than ASML's machines. A chip can take around 3 months going through various steps repeatedly.

ASML's machines are very impressive, but they're just one piece of that puzzle. And ASML themselves rely on collaborators like Zeiss.

This idea that it's all just capital and others are reluctant to invest otherwise they could duplicate TSMC simply false.

Re:Microsoft introduces its own chips for AI, with eye on cost by scarface_74 on Wednesday November 15, 2023 @07:38PM (#38284462)
TSMC makes a lot of money from fabricating chips on old technology using fully depreciated assets. No new competitor is going to spend billions today to fab chips on older technology.
Re:Microsoft introduces its own chips for AI, with eye on cost by jasonwatkinspdx on Wednesday November 15, 2023 @06:57PM (#38284124)
It's insanely hard.

TSMC is so dominant because they have very, very, deep institutional knowledge. Even if you have billions to invest it's not easy to create that, and definitely impossible to do it short term.

There's only 3 companies left chasing smaller nodes. Everyone else has given up and are focusing on revenue from high volume parts in older processes.

Re:Microsoft introduces its own chips for AI, with eye on cost by Flameancer on Wednesday November 15, 2023 @08:29PM (#38284846)
The only three are Samsung, Intel, and TSMC. Idk why going on with Intel but Samsung should BSs doing better but that institutional knowledge that TSMC has is crazy. They all technically invest in asml that makes the machines. If I had to redo my education I’d get into electrical engineering just for this.
Re:Microsoft introduces its own chips for AI, with eye on cost by B1FF_PSUVM on Wednesday November 15, 2023 @08:39PM (#38284920)
> I’d get into electrical engineering just for this

I get the impression it's mostly physics guys.

Re:Microsoft introduces its own chips for AI, with eye on cost by lethal-radio on Wednesday November 15, 2023 @09:21PM (#38285185)
Everything is physics when you get down to the fundamentals.
Re:Microsoft introduces its own chips for AI, with eye on cost by doubloon on Wednesday November 15, 2023 @10:22PM (#38285532)
So "Chemistry, the central science" did not convince you?
Re:Microsoft introduces its own chips for AI, with eye on cost by aleph_minus_one on Wednesday November 15, 2023 @10:23PM (#38285536)
> Everything is physics when you get down to the fundamentals.

Relevant xkcd: https://xkcd.com/435/

TLDR: Math is not. :-)

Re:Microsoft introduces its own chips for AI, with eye on cost by EVa5I7bHFq9mnYK on Thursday November 16, 2023 @03:07AM (#38286887)
Nah, neither physics nor electrical engineering. It's all chemistry at TSMC.
Re:Microsoft introduces its own chips for AI, with eye on cost by jasonwatkinspdx on Wednesday November 15, 2023 @10:10PM (#38285465)
Eh, the process engineers I've talked to don't have a great life, at least here in the US. It seems inevitable you end up perpetually on call for some machine, and I don't mean some type of machine, I mean unit #23 over in fab #4 and then that's your baby for years. The pay is considerable worse than software too.

I almost went to get a CE degree because I find it all so fascinating but ultimately I'm glad I didn't.

Re:Microsoft introduces its own chips for AI, with eye on cost by andy_ppp on Thursday November 16, 2023 @04:28AM (#38287389)
If you want the best people to work in an area you need to pay them. I'm surprised given the possible returns these aren't seven figure jobs.
Re:Microsoft introduces its own chips for AI, with eye on cost by red-iron-pine on Thursday November 16, 2023 @10:54AM (#38291077)
the pay is worse than software because you're competing with Asian wages in a manufacturing context, where the margins are slim.

the serious system architects, designers, and fab managers are doing just fine, software or not. the dudes in Phoenix who are getting pushed through 2-year degrees to help run a clean room are probably making 65k.

Re:Microsoft introduces its own chips for AI, with eye on cost by nextaccountic on Wednesday November 15, 2023 @10:54PM (#38285685)
If enough funding magically appeared, GlobalFoundries could be a contender, right?
Re:Microsoft introduces its own chips for AI, with eye on cost by rr808 on Wednesday November 15, 2023 @11:50PM (#38285900)
> If I had to redo my education I’d get into electrical engineering just for this.

This is the crazy thing. Such fundamental important technology but salaries generally suck. Much more money in cat memes and influencer channels.

Re:Microsoft introduces its own chips for AI, with eye on cost by buildbot on Wednesday November 15, 2023 @11:52PM (#38285907)
Yeah the salaries for EEs are really depressing in most of the industry. It's really hard work. Most EEs end up leaving for software or research (I did!).
Re:Microsoft introduces its own chips for AI, with eye on cost by vasco on Thursday November 16, 2023 @03:28AM (#38286988)
I took EECS, did a masters in analog design and I've only worked professionally making shitty SaaS websites. Making way more money with way less stress while still feeling accomplished that I learned how to do the complex stuff I wanted to know how. Very hard to make nearly as much otherwise.
Re:Microsoft introduces its own chips for AI, with eye on cost by ClimaxGravely on Thursday November 16, 2023 @11:26PM (#38299572)
I went to school for CS while one of my best friends went for EE. It definitely seemed like the far more complex discipline.

In fact for a small project in an elective he programmed a computer vision system that was far ahead of anything me or my peers had made at the time in our CS program. He had pretty much zero programming experience.

I must admit he's a particularly smart person but it was crazy that I went on to make more money than him. His work is way more complicated than mine as far as I can tell.

Re:Microsoft introduces its own chips for AI, with eye on cost by msolujic on Thursday November 16, 2023 @12:33AM (#38286101)
There is one more player joining that small club, Huawei
Re:Microsoft introduces its own chips for AI, with eye on cost by dataking on Thursday November 16, 2023 @03:01AM (#38286854)
I was under the impression they had their chips manufactured by SMIC.
Re:Microsoft introduces its own chips for AI, with eye on cost by dontlaugh on Thursday November 16, 2023 @04:04AM (#38287207)
Exactly, the fourth player quickly catching up to the others is SMIC.
Re:Microsoft introduces its own chips for AI, with eye on cost by Goodroo on Thursday November 16, 2023 @03:43AM (#38287075)
If there's one company that has the capability to become a Samsung/Intel (IDM) on steroids, it is Huawei. They have the money,talent, determination and state backing.
Re:Microsoft introduces its own chips for AI, with eye on cost by esskay on Thursday November 16, 2023 @04:37AM (#38287451)
Presumably only for their own and Chinese brands however as I can't see anyone letting them do fabication for major players outside of China. They've also got a huge hurdle given they cant buy the standard equipment every chip fab needs owing to it all being produced by a single company.
Re:Microsoft introduces its own chips for AI, with eye on cost by bluedino on Wednesday November 15, 2023 @06:56PM (#38284108)
Why doesn't anyone enter? It takes billions and billions of dollars, tons of knowledge and if you get it wrong...even Intel screwed it up, and they are one of the only companies would could even try to do it.
Re:Microsoft introduces its own chips for AI, with eye on cost by spiralpolitik on Wednesday November 15, 2023 @07:31PM (#38284404)
Right now Intel is hamstrung because there is no separation between the fab and design sides. Nobody is going to trust Intel to fab their latest and greatest while the two sides are joined at the hip.

The sooner Intel spins out the fab side into its own entity the better positioned it will be to pick up the business that TSMC doesn't have capacity for.

Re:Microsoft introduces its own chips for AI, with eye on cost by michaelt on Thursday November 16, 2023 @03:31AM (#38286996)
I've seen plenty of Amazon's competitors running on AWS, plenty of Google's competitors using gmail, and suchlike.

People will overlook a lot, if the product is compelling enough and the sales guys can keep a straight face while promising not to peek.

Re:Microsoft introduces its own chips for AI, with eye on cost by sofixa on Thursday November 16, 2023 @05:25AM (#38287813)
But the whole problem at Intel is that they're not at the level of TSMC, they're years and generations behind. Splitting them up won't just magically make the fab business be better, and without the profit margins of the sale of processors it's unlikely they'll have the resources to invest to get them to be good. Case in point: AMD are doing very well after spinning off their fabs, but their fabs are not doing very well (relatively of course - they're just stuck to where they split and haven't had meaningful advances; but they're still a profitable business because those older chips are needed too).
Re:Microsoft introduces its own chips for AI, with eye on cost by goodbyesf on Wednesday November 15, 2023 @08:25PM (#38284817)
> It takes billions and billions of dollars

Apple and Microsoft are trillion dollar companies ( both nearing $3 trillion market caps ). They can afford it. Heck they have the balance sheet to acquire both tsmc and samsung if either were up for sale.

I thought Apple was moving towards being a full-stack company. Where all the hardware and software is developed in-house. If anyone has the resources, it is apple.

Re:Microsoft introduces its own chips for AI, with eye on cost by aleph_minus_one on Wednesday November 15, 2023 @10:30PM (#38285577)
> I thought Apple was moving towards being a full-stack company. Where all the hardware and software is developed in-house. If anyone has the resources, it is apple.

Having a modern chip fab binds an insane amount of capital, and makes you much more vulnerable in case of market turbulences. This is exactly a reason why there exist people who like to claim that Intel should spin off their fabs.

Re:Microsoft introduces its own chips for AI, with eye on cost by andy_ppp on Thursday November 16, 2023 @04:37AM (#38287448)
Depends how those market turbulences occur, for example a Chinese invasion of Taiwan will be a disaster for Apple.
Re:Microsoft introduces its own chips for AI, with eye on cost by scarface_74 on Wednesday November 15, 2023 @11:50PM (#38285898)
It would be value destructive for Apple to buy TSMC and not service any other customers
Re:Microsoft introduces its own chips for AI, with eye on cost by frakkingcylons on Wednesday November 15, 2023 @07:05PM (#38284190)
Building and operating a fab is an extremely difficult and expensive task that will take at least 5-10 years to bear fruit. That makes it a high-risk venture which is hard to sell to the board and investors.

More importantly, the new chip production lines are dependent on hyper-specialized EUV lithography systems that only company is able to manufacture (ASML). ASML has their own limits to production too.

Re:Microsoft introduces its own chips for AI, with eye on cost by Nokinside on Wednesday November 15, 2023 @07:36PM (#38284446)
Enter? Companies are trying to keep up.

Just few years ago was four companies doing the bleeding edge: Intel, GlobalFoundries, Samsung and TSMC. Intel was the best. First Global Foundries could not keep up. Then Intel fumbled ant TSMC became the best. Samsung is the only one keeping up with TSMC but they come slightly behind. Intel tries to catch up the two. No companies have "exited" they just can't compete.

The bleeding edge semiconductor node design is like doing Apollo moon program every 4-5 years. Only one can be the best.

Re:Microsoft introduces its own chips for AI, with eye on cost by tester756 on Wednesday November 15, 2023 @07:42PM (#38284496)
>Why aren't any other companies entering this space?

There are? INTC and Samsung?

>falling exclusively under PROC control

It wouldnt fall under PROC control.

It would be destroyed.

Re:Microsoft introduces its own chips for AI, with eye on cost by Flameancer on Wednesday November 15, 2023 @08:34PM (#38284883)
Plus I don’t even think PRoC would know how to operate the EUV machines.
Re:Microsoft introduces its own chips for AI, with eye on cost by keep_reading on Wednesday November 15, 2023 @07:50PM (#38284562)
The USA would certainly bomb it if they had to
Re:Microsoft introduces its own chips for AI, with eye on cost by OoooooooO on Wednesday November 15, 2023 @08:03PM (#38284654)
TSMC fabs have bombs build in to destroy everything if PROC invades I've read.
Re:Microsoft introduces its own chips for AI, with eye on cost by gruez on Wednesday November 15, 2023 @10:12PM (#38285481)
That's a bit hyperbolic don't you think? Sure, they're the only game in town when it comes to the leading edge nodes (eg. 3nm), but there's plenty of options at 14 nm and above. That corresponds to AMD zen (released in 2017) and Intel skylake (released in 2015). They're significantly worse than the latest and greatest CPUs today, but they're still in use today. I'd hardly call that as "going back to the stone age".
Re:Microsoft introduces its own chips for AI, with eye on cost by jasonwatkinspdx on Thursday November 16, 2023 @01:38AM (#38286396)
You read bullshit.
Re:Microsoft introduces its own chips for AI, with eye on cost by aseipp on Thursday November 16, 2023 @11:28AM (#38291576)
I also have a bridge I can sell you. And trust me: you've never seen one like this, at rates like I'm offering! Buy now!
Re:Microsoft introduces its own chips for AI, with eye on cost by blackoil on Wednesday November 15, 2023 @09:55PM (#38285397)
And, If china bombs ASML we'll be back to stone age.
Re:Microsoft introduces its own chips for AI, with eye on cost by nradov on Wednesday November 15, 2023 @11:21PM (#38285768)
How would China do that exactly? None of their bombers have sufficient range.
Re:Microsoft introduces its own chips for AI, with eye on cost by dfadsadsf on Wednesday November 15, 2023 @11:46PM (#38285875)
They have intercontinental ballistic missiles. If needed, they can be retrofitted with non-nuclear payload.
Re:Microsoft introduces its own chips for AI, with eye on cost by buildbot on Thursday November 16, 2023 @12:02AM (#38285947)
China launching any kind of missile at ASML is WW3
Re:Microsoft introduces its own chips for AI, with eye on cost by nradov on Thursday November 16, 2023 @08:39AM (#38289361)
The Chinese aren't stupid enough to do that. Any launch of ICBMs at a NATO country would be interpreted as a possible nuclear attack and draw an immediate US counterforce strike.
Re:Microsoft introduces its own chips for AI, with eye on cost by otabdeveloper4 on Thursday November 16, 2023 @12:56AM (#38286230)
No, you'll just have to learn how to write software again.
Re:Microsoft introduces its own chips for AI, with eye on cost by ksec on Wednesday November 15, 2023 @08:13PM (#38284723)
>it's not like the market couldn't bear more competitors.

The market could only bear if they are willing to pay a lot more in the name of diversification. Otherwise most would simply have trouble keeping up.

We really need some basic FAQ on HN for hardware technology related topic.

Re:Microsoft introduces its own chips for AI, with eye on cost by deepnotderp on Wednesday November 15, 2023 @08:30PM (#38284859)
It’s not for a lack of trying on Samsung’s and intel’s part that tsmc is dominant ;)
Re:Microsoft introduces its own chips for AI, with eye on cost by thoiu2342343 on Wednesday November 15, 2023 @08:49PM (#38284985)
It's worse. It's one company in a 'contested' territory. So much so that US military is rumored to have considered the 'samson option' of bombing the TSMC facility were the PLA to occupy the island.

Taiwan (unlike Ukraine) is far too critical to the world economy.

Re:Microsoft introduces its own chips for AI, with eye on cost by blackoil on Wednesday November 15, 2023 @09:50PM (#38285375)
By internal and external claims, Intel is on track to be competitive with TSMC by 2025. And, Nvidia and other will use the capacity as soon it is available.
Re:Microsoft introduces its own chips for AI, with eye on cost by throwaway2990 on Wednesday November 15, 2023 @11:19PM (#38285760)
> retake Taiwan

Take Taiwan. You can’t “retake” something you never had.

Re:Microsoft introduces its own chips for AI, with eye on cost by huytersd on Thursday November 16, 2023 @02:15AM (#38286585)
And TSMC uses the ASML fabrication machines made by… one company. Basically two places are responsible for all of those chips. Intel really needs to get back in the game. Hopefully that’s still on the table.
Re:Microsoft introduces its own chips for AI, with eye on cost by thfuran on Thursday November 16, 2023 @04:58AM (#38287599)
Even if Intel could spin up a bunch of fabs competitive with tsmc, they'd still be competing for asml's capacity. We just can't massively scale up leading edge fab capacity.
Re:Microsoft introduces its own chips for AI, with eye on cost by esskay on Thursday November 16, 2023 @04:36AM (#38287444)
> Why aren't any other companies entering this space?

Because it would take over a decade to build a comparable chip fab and thats assuming you had unlimited cash to throw at it.

You'd be spending billions with zero revenue for a decade and no guarantees it'll be anything as close to as good as TSMC's setup. Try finding someone willing to invest in that and it becomes clear why theres not more chip fabs out there.

Re:Microsoft introduces its own chips for AI, with eye on cost by sofixa on Thursday November 16, 2023 @04:59AM (#38287618)
> It feels like China and the U.S. are on a path to war in the next decade or so

IMO, MAD (mutually assured destruction - if a nuclear power start a war with another nuclear power, both will probably end up destroyed by nukes) makes the prospects of that highly unlikely.

Re:Microsoft introduces its own chips for AI, with eye on cost by red-iron-pine on Thursday November 16, 2023 @10:50AM (#38291035)
> It feels like China and the U.S. are on a path to war in the next decade or so

they are literally having discussions in San Fran right now to reduce the likelihood of that happening. And it sounds like China is quite open to discussion, and the US as well.

Re:Microsoft introduces its own chips for AI, with eye on cost by NicoJuicy on Thursday November 16, 2023 @05:02PM (#38296211)
Well. China is promising things and they'll ignore it as usual until they are sure to have the upperhand.

They are building navy fleet like no other.

Still harassing neighbors ( eg. Philippines).

Nothing changed. They just want a bigger advantage.

Re:Microsoft introduces its own chips for AI, with eye on cost by Nokinside on Wednesday November 15, 2023 @07:52PM (#38284569)
They buy capacity that is little behind and optimized differently. Apple and Nvidia buy the bleeding edge and develop it with TSCM.

Azure Maia is TSMC N5, I think.

Nvidia H200 and H100 are TSMC 4N.

Re:Microsoft introduces its own chips for AI, with eye on cost by UncleOxidant on Wednesday November 15, 2023 @08:03PM (#38284650)
Intel Foundry apparently has some room.