News for hackers. Stuff that matters.
Re:Google open-sources TorchTPU, a native PyTorch back end f... by 23agt on Tuesday October 20, 2026 @01:27PM (#50169752)
Google is selling TPU shovels via Cloud services and also physically to select partners. So this makes sense.

There will be an abundance of shovels. Nebius already crashed by almost half from its hype peak.

Re:Google open-sources TorchTPU, a native PyTorch back end f... by airza on Tuesday October 20, 2026 @01:33PM (#50169820)
it doesn't seem like there's an abundance of shovels coming anytime soon
Re:Google open-sources TorchTPU, a native PyTorch back end f... by juleiie on Tuesday October 20, 2026 @04:30PM (#50172225)
Shovels and gold aren’t the problem, humans are the problem

either AI achieves hyper-efficiency and triggers systematic economic demand destruction due to unemployment, or it underperforms and sparks a massive tech-sector asset bubble burst

If AI is as good as valuations - it crashes. If AI isn’t as good, it crashes. all eggs in one basket economy.

Every future leads to a massive financial shitstorm

AI is priced in as a technology to end all markets. The last bull market you will ever see.

It’s a miracle markets didn’t notice this “damned if you succeed damned if you don’t” type of inevitable checkmate

I have been building a bunker

Re:Google open-sources TorchTPU, a native PyTorch back end f... by bsder on Tuesday October 20, 2026 @08:17PM (#50174480)
> It’s a miracle markets didn’t notice this “damned if you succeed damned if you don’t” type of inevitable checkmate

They learned from 2008 that Too Big Too Fail(tm) means the government bails you out.

This was the problem with not OBLITERATING the banks in 2008. Had the US government taken over the banks and wiped the investors, there would be more pushback right now.

Re:Google open-sources TorchTPU, a native PyTorch back end f... by omgwtfbyobbq on Tuesday October 20, 2026 @05:32PM (#50172986)
It's possible. If goog's AI overview is accurate, it seems somewhat similar to speculative euphoria seen in the past (eg companies involved in electricity prior to the great depression). It's larger (currently 35% for AI versus 25% for electric/related cos), I'm guessing because of more credit. At the same time, the housing component of the market prior to the GFC was about 23%, and it wasn't as economically damaging as the GD, so hopefully the AI bubble unwinding won't be as bad.
Re:Google open-sources TorchTPU, a native PyTorch back end f... by esseph on Tuesday October 20, 2026 @05:50PM (#50173186)
> so hopefully the AI bubble unwinding won't be as bad

It's currently larger than the 1880s railroad boom.

"Overbuilding and speculative debt ultimately culminated in the Panic of 1893, plunging the nation into a severe economic depression."

Re:Google open-sources TorchTPU, a native PyTorch back end f... by omgwtfbyobbq on Tuesday October 20, 2026 @06:56PM (#50173835)
Not according to Goog's. The railroad bubble of the 1880s was supposedly 60+% of the market. It may not be accurate though.

"During the 1880s, private railroad enterprises represented over 60% of the total capitalization of the entire U.S. stock market, peaking at 63% in 1881 and 1885."

Re:Google open-sources TorchTPU, a native PyTorch back end f... by esseph on Wednesday October 21, 2026 @11:55AM (#50183101)
AI spending is significant more in inflation adjusted dollars. (Roughly 550 Bn in modern dollars). We're projecting trillions in AI spend.

But as a % of total GDP, you are correct.

Re:Google open-sources TorchTPU, a native PyTorch back end f... by omgwtfbyobbq on Wednesday October 21, 2026 @05:26PM (#50187885)
I asked Goog's for enterprise value of the sector as a percentage of total market in all 4 situations, so it's not exact because enterprise value isn't available back to the 1800s, but it should be ballpark assuming the overall picture is accurate.

In terms of infra spending as a percent of GDP, 1880s railroads were at 5-6% at peak while AI is estimated to reach 3+% in a year or two.

Re:Google open-sources TorchTPU, a native PyTorch back end f... by tjwebbnorfolk on Tuesday October 20, 2026 @06:52PM (#50173788)
Everyone says there's a massive compute shortage. But where is it showing up? For whom is there a shortage?

Every time I ask Claude to do something, it does it just fine. I never have to wait in any sort of queue that would be common in other kinds of shortages.

Re:Google open-sources TorchTPU, a native PyTorch back end f... by eitally on Tuesday October 20, 2026 @07:28PM (#50174111)
It's showing up for enterprises (and ISVs) who need capacity from cloud vendors and can't get it. Sometimes there are some GPU shapes available, but not always what you either need or want to pay for (e.g. a TPU vs a V100 vs a B300), and also not always in spot instances (frequently not).

The hyperscalers are all so oversubscribed that they require commits from enterprises so if you only have a transient need you might be out of luck [from your vendor of choice]. Additionally, not all GPU service providers are equal. Semi Analysis has some great articles explaining why.

Re:Google open-sources TorchTPU, a native PyTorch back end f... by octoberfranklin on Tuesday October 20, 2026 @09:34PM (#50174995)
But where is it showing up?

Pricing -- exactly where shortages show up in a free market economy.

Re:Google open-sources TorchTPU, a native PyTorch back end f... by tjwebbnorfolk on Wednesday October 21, 2026 @11:23AM (#50182576)
Right, but pricing is for the marginal unit of hardware.

what I'm wondering: is there a shortage of compute in the current installed base? Why isn't the installed base of compute increasing drastically in price, and/or forcing me to wait in a queue to use it?

Re:Google open-sources TorchTPU, a native PyTorch back end f... by octoberfranklin on Wednesday October 21, 2026 @07:55PM (#50189258)
Why isn't the installed base of compute increasing drastically in price

Have you looked at RAM prices lately?

Re:Google open-sources TorchTPU, a native PyTorch back end f... by tjwebbnorfolk on Sunday October 25, 2026 @12:26PM (#50233286)
That's not the installed base. If you're buying RAM, that RAM isn't installed yet.

Installed base is existing computers that already have RAM. Why aren't VM rental prices going way up?

Re:Google open-sources TorchTPU, a native PyTorch back end f... by tjwebbnorfolk on Sunday October 25, 2026 @12:28PM (#50233302)
Right, but also shouldn't it be showing up in rationing as well? i.e. why am I not in a 4-hour-long queue waiting for Claude to respond?
Re:Google open-sources TorchTPU, a native PyTorch back end f... by octoberfranklin on Monday October 26, 2026 @11:07AM (#50245056)
facepalm

No, rationing is what you get in command/centralized economies like the USSR. In free market economies you get price explosion, like we're seeing right now with DRAM wafers.

Re:Google open-sources TorchTPU, a native PyTorch back end f... by airza on Wednesday October 21, 2026 @10:02AM (#50181154)
have you tried to purchase a device with RAM or a GPU in the last two years?
Re:Google open-sources TorchTPU, a native PyTorch back end f... by tjwebbnorfolk on Wednesday October 21, 2026 @11:22AM (#50182553)
Yes it's all very expensive. But is there not enough compute in general? Or is there not enough extra compute for me personally where I want it ?

like, I can rent a VM from AWS for the same price as 5 years ago...

Re:Google open-sources TorchTPU, a native PyTorch back end f... by bornfreddy on Wednesday October 21, 2026 @11:09AM (#50182335)
I mean there is an abundance of shovels - but everyone wants to dig with excavators, and there's a shortage of those.