News for hackers. Stuff that matters.
Re:TPU transformation: A look back at 10 years of our AI-spe... by mike_hearn on Sunday August 04, 2024 @08:25AM (#41153081)
That wouldn't work. Even TPUv4 was on a 7nm node and you don't just build a 7nm fab just like that. If it were that easy NVIDIA would already be building their own fabs, as they have basically raised as much capital as there is in the known universe (bigger market cap than the entire London stock exchange), but they seem to prefer to let the fab experts get on with it rather than compete with them.

LLM AI is largely HBM bottlenecked anyway i.e. Samsung, SK Hynix and Micron are where the supply chain limits enter the picture.

Re:TPU transformation: A look back at 10 years of our AI-spe... by throwaway48476 on Sunday August 04, 2024 @08:56AM (#41153217)
Fabless companies that are large enough such as apple front the capital for fab companies like TSMC to build fabs dedicated to their use. They do, in effect, build their own fabs. If the Google TPU group had the inclination they could have done the same.

The memory industry just got busted from the covid bubble and are not too keen to jump into the AI bubble.

Re:TPU transformation: A look back at 10 years of our AI-spe... by ragebol on Sunday August 04, 2024 @09:27AM (#41153388)
They might front the money, but don't own them. Apple gladly lets someone else own and operate the fabs and take the risk (which is smaller with Apple as a client)
Re:TPU transformation: A look back at 10 years of our AI-spe... by nsteel on Sunday August 04, 2024 @09:53AM (#41153550)
Let's not forget that a 7nm fab has a very limited period of usefulness for the likes of Apple etc. That leading edge is always moving forward and while it might be financially viable for some aspects of the process to be upgraded to the next node, that's not always the case and that's where TSMC's hundreds of other customers join in and the (now old) equipment can be still used for many more years.

Edit: But perhaps with the exclusivity deals, the likes of TSMC are less reliant on spreading the cost over 15+ years than they used to be. To be clear, I was talking about long-term use.

Re:TPU transformation: A look back at 10 years of our AI-spe... by throwaway48476 on Sunday August 04, 2024 @09:58AM (#41153581)
The leading edge has slowed down a lot. Apple is still selling M1 chips and AMD is just now releasing new models of zen3 AM4 chips.
Re:TPU transformation: A look back at 10 years of our AI-spe... by throwaway48476 on Sunday August 04, 2024 @09:47AM (#41153507)
There is more co development and risk sharing than you think. TSMC has nodes only apple uses.
Re:TPU transformation: A look back at 10 years of our AI-spe... by nsteel on Sunday August 04, 2024 @10:03AM (#41153611)
They do, but as far as I know those nodes are just early/late verisons and tweaks to the main, popular process.
Re:TPU transformation: A look back at 10 years of our AI-spe... by michaelt on Sunday August 04, 2024 @02:43PM (#41155445)
But if Apple pays TSMC $$$$$$$$ in advance to build a 2nm node production line especially for Apple, and it turns out the 2nm node doesn't deliver the hoped-for improvements in power efficiency? The money's already spent.
Re:TPU transformation: A look back at 10 years of our AI-spe... by rpeden on Sunday August 04, 2024 @02:14PM (#41155318)
Unless they've been issuing a ton of new shares recently and then selling them into the market at something resembling the current share price, the amount of capital they've raised is nowhere near their current market cap.

But it looks like they've actually been buying back some shares - they've got fewer shares outstanding than they did a year or two ago.

Not that it matters much - they've still got plenty of cash and other capital available.