Re:Nvidia Was in Trouble Before the Jensen Huang Mess
by SV_BubbleTime on Monday November 16, 2026 @11:06AM
(#50519138)
The best piece of media advice I ever received was that “anything you see in a large media outlet, was put there in order to affect somebody’s stock price, somewhere”
Re:Nvidia Was in Trouble Before the Jensen Huang Mess
by shevy-java on Monday November 16, 2026 @11:14AM
(#50519238)
> A key role enabling the AI gold rush thanks in large part to its recently ousted CEO Jensen Huang.
Well - I think the article kind of conflates the problems here.
First - I don't call it "AI gold rush" but instead "AI mafia rush". After all
the RAM prices have exploded. Why do we have to pay more because of these
gangster companies? Why are governments not doing anything about it? But this
is a separate discussion really.
Second - I feel that the "Jensen Mess" is a strange expression, because ...
which mess exactly? Does the article refer to NVIDIA having problems? Or
does it refer to Jensen and his unstoppable affection for multiple ladies
at the same time? Or is it not because of the female non-spy (though, do
we know that) but the female spy (though, do we know that)? How many more
ladies are part of the Jensen story here?
To me this reminds me a little bit of the issues with regards to Kevin Spacey.
Now - the situation is not the same, because personally I think Kevin is a bit
creepier here, so this is not 1:1 comparable. But Kevin also is a great actor,
he coined numerous iconic scenes (L. A. confidential, Usual Suspects, or my
favourite being his performance in American Beauty); and Jensen also was highly
successful with regards to NVIDIA. Or, we can also take Michael Jackson - I do
not think anyone doubted his skills with regards to art, music and expression
(dance), but many may remember the awkward connection he had with some children.
These situations are all quite different, but what exactly does the article
mean with "The Jensen Mess"? The sex life seems to always be of more interest
than other things. That was also the case with Bill Clinton.
// what exactly does the article mean with "The Jensen Mess"?
He facilitated a massive circumvention of a strategic export ban to China and played a key role in their ability to distill IP and Advantage from the US AI Companies.
His major gaffe was allowing the public a view behind the curtain to see Oz as human and fallible - and thus the custodian of $2 Trillion of market worth as unsafe. Vitalik Buterin ain't ever falling for a honeypot by comparison.
Re:Nvidia Was in Trouble Before the Jensen Huang Mess
by adrian_b on Monday November 16, 2026 @12:00PM
(#50519830)
> He facilitated a massive circumvention of a strategic export ban
This lacks an "allegedly".
For now, even if I also believe that it is very likely that he facilitated a circumvention of the export ban, because that would have been profitable for NVIDIA, no evidence whatsoever has been presented publicly to support this, only pure speculation.
Re:Nvidia Was in Trouble Before the Jensen Huang Mess
by skulk on Monday November 16, 2026 @11:28AM
(#50519427)
> Why do we have to pay more because of these gangster companies?
This is the free market; demand is high and supply is limited so price goes up. Don't like it? Start making your own and benefit from the higher prices!
Re:Nvidia Was in Trouble Before the Jensen Huang Mess
by dgellow on Monday November 16, 2026 @11:45AM
(#50519641)
It’s very likely the limited supply has been exaggerated deliberately by NVIDIA. That’s the whole point of the circular financing scheme they’ve developed over the past 3+ years
Re:Nvidia Was in Trouble Before the Jensen Huang Mess
by trollbridge on Monday November 16, 2026 @03:16PM
(#50522558)
Works fine if you want to run Qwen, etc. or do OCR stuff.
I really only have it for data locality - some customers simply don’t have approval for me to share data from their customers with random cloud inference providers. I also use Bedrock for that but it’s expensive
Re:Nvidia Was in Trouble Before the Jensen Huang Mess
by krige on Monday November 16, 2026 @11:53AM
(#50519734)
No, it's wearing the free market's corpse as a face. The incentives and mechanisms are perverted and investigations into things like price fixing are being launched though.
Re:Nvidia Was in Trouble Before the Jensen Huang Mess
by windexh8er on Monday November 16, 2026 @11:55AM
(#50519764)
> This is the free market; demand is high and supply is limited so price goes up.
Free markets can be abused. Demand, in NVIDIA's case, seems to be not all that Jensen, and the company, had been stating. If the core demand was AI companies that were being funded by NVIDIA itself - then it wasn't organic demand.
If "... at least $200 billion worth of NVIDIA AI GPUs are sitting idle in warehouses after being purchased by cloud giants that lacked either the electrical grid capacity or immediate end-user demand to power them on" [0] is true then the demand wasn't there. There's zero reason to pre-purchase a GPU a year, even 6 months, ahead of build. Sure, maybe Google / Amazon / SpaceX buy during build - but these companies actually build their DCs, they don't buy GPUs and store them in a warehouse for quarters on end unless something went wrong (maybe like in Finland [1]). Jensen may very well be in a lot deeper than anyone really knows. The reporting as of late has stated that commitments by NVIDIA to memory suppliers was coming in and there was likely not enough non-circular capital to cover. The reality is Jensen likely thought he was going to be the AI kingpin, having a piece of all the AI pie and that he'd have enough time to recoup his ponzi-like investments in the downstream by paying for his own products.
I, personally, don't think we've even seen the start of this story. It's probably a huge mess starting with Jensen and flowing down through his kids. I can't imagine everything was on the up and up given the scale of dollars involved. It almost feels like the affair was a scapegoat to get out of the hot seat. Ultimately time will tell.
But, TL;DR - if you think the demand for NVIDIA was completely organic, well then I have a crate of Founder's Edition 5090's to sell you for dirt cheap.
Re:Nvidia Was in Trouble Before the Jensen Huang Mess
by nullc on Monday November 16, 2026 @12:30PM
(#50520225)
> at least $200 billion worth of NVIDIA AI GPUs are sitting idle in warehouses after being purchased by cloud giants that lacked either the electrical grid capacity
People I know with adequate space and power have also heard these rumors and have looked high and low for parties with these billions worth of idle GPUs-- either to purchase their hardware or offer them hosting-- and cannot find them.
I think people are just making this up. If I'm wrong and you know someone in need, let me know and I can connect them with someone with 2GW+ of capacity.
Re:Nvidia Was in Trouble Before the Jensen Huang Mess
by windexh8er on Monday November 16, 2026 @01:15PM
(#50520841)
The thing is, if it is true (I don't doubt it since the numbers don't add up and because NVIDIA has conveniently been unable to account for GPUs exported) nobody is going to sell them outright to someone else. Why? Simply because they never paid for them in the first place. If NVIDIA funds the startup to buy the GPU it would be odd to think that there aren't legal restrictions in the deal financing that would inhibit resale. Maybe Jensen wanted to be the Ticketmaster of GPUs?
Sure, it sounds simple but again, I don't think we understand any of the complex web of moving parts that are involved here.
Re:Nvidia Was in Trouble Before the Jensen Huang Mess
by tygon on Monday November 16, 2026 @12:20PM
(#50520079)
This mindset has its flaws now as it often does. It is a high tech, high barrier field, so it is unlikely for companies to just pop up. Because of the scope of creating something that could rival Nvidia, it is risky and thus you will also not get many investors.
So, you will not have money and you are going into a field with big competition where all you have to go on is "well, I surely could do better." Not impossible, but that takes existing establishment in the field. You are not going to see mom and pop chip companies. Not without some major breakthrough that sets them apart.
Re:Nvidia Was in Trouble Before the Jensen Huang Mess
by seizethecheese on Monday November 16, 2026 @11:18AM
(#50519284)
Post hoc rationalization. Nothing in here was unknown on 10/29 when the scandal broke, yet the stock market value was pretty durable before this and dropped a ton after.
Re:Nvidia Was in Trouble Before the Jensen Huang Mess
by louthy on Monday November 16, 2026 @12:04PM
(#50519871)
Of course, you’re describing risk. Which is how players in the markets make investment decisions. Nvidia are now a more risky investment, until proven otherwise.
Re:Nvidia Was in Trouble Before the Jensen Huang Mess
by stetrain on Monday November 16, 2026 @12:45PM
(#50520428)
The markets saw Nvidia as an increasing risk before the actual decision to fire him, so that doesn't seem to be the single incident causing uncertainty. That risk and uncertainty already existed whether or not he resigned or was fired.
Re:Nvidia Was in Trouble Before the Jensen Huang Mess
by louthy on Monday November 16, 2026 @01:08PM
(#50520743)
I never claimed it was a single incident. Risk profiles are an ongoing metric that take in myriad factors. Some weighted more than others. Losing the co-founder and CEO of 30+ years would have a heavy weighting, causing uncertainty until a new CEO has proven the ship is steady. Of course, the potential AI bubble is a factor too. Losing your experienced CEO just before a potential popping of said bubble is also an extra factor to add to the risk metric.
Re:Nvidia Was in Trouble Before the Jensen Huang Mess
by stetrain on Monday November 16, 2026 @12:02PM
(#50519848)
The share price slide happened before the resignation. Uncertainty, sure, but if the only change were that Jensen had not yet resigned as of today, that uncertainty would still not be resolved.
Re:Nvidia Was in Trouble Before the Jensen Huang Mess
by stetrain on Monday November 16, 2026 @12:44PM
(#50520403)
The story of the affair(s) and the Chinese spy were, yes. My point is that those stories and uncertainty seemed to have done most of the share price damage so far. The actual act of pushing out Jensen resolved some of that uncertainty. If everything had played out the same but the board had not pushed him to resign, I'm not sure things would be resolved any better currently or in the near future.
Re:Nvidia Was in Trouble Before the Jensen Huang Mess
by bryanlarsen on Monday November 16, 2026 @11:31AM
(#50519480)
Which is very typical. It's one thing to recognize a bubble; it's another to predict when it's going to pop.
There were lots of traders who lost a lot of money betting against the housing bubble pop in 2005. The bubble was front page news on the Economist in 2005. Michael Burry made a lot of money because it took him a couple of years to assemble the money to be able to bet against the market and so he got lucky on the timing.
Or as the aphorism goes: the market can stay irrational longer than you can stay solvent.
Re:Nvidia Was in Trouble Before the Jensen Huang Mess
by MyHonestOpinon on Monday November 16, 2026 @11:35AM
(#50519534)
Isn't there a bit of popular wisdom that goes like this? "If you want to time the market you have to get two bets almost perfectly right. When to get out and when to get back in"
Re:Nvidia Was in Trouble Before the Jensen Huang Mess
by bigfishrunning on Monday November 16, 2026 @12:40PM
(#50520344)
> It's peak delusion to think that AI is going away.
Even if it's not going away, it'll be a breath of fresh air when it's not shoved into every possible place as a marketing tactic, even when it's not necessary or beneficial. AI does have it's place, I just hope we realize soon how every place is not that place.
Re:Nvidia Was in Trouble Before the Jensen Huang Mess
by booty on Monday November 16, 2026 @01:13PM
(#50520807)
I think the ultimate role of AI is probably going to be "every place", just not... foregrounded.
It will follow the same pattern that technologies like phones, computers themselves, the internet, and (I guess) cloud storage now touch on nearly everything.
Example: even if you're an old-fashioned boutique leather artisan who makes handmade bespoke horse saddles in 2026 like it was 1783... your business also probably uses all that other stuff in some capacity. You probably have some computers for design and payroll and answering emails, a website that lives somewhere in the cloud, etc.
On a closely related note, if you're tired of hearing "AI, AI, AI" everywhere, there's reason to feel encouraged. Ten years ago, nobody would shut the fuck up about "the cloud." It didn't go away, it just matured and now it's how most people do many things.
Re:Nvidia Was in Trouble Before the Jensen Huang Mess
by grey-area on Monday November 16, 2026 @12:41PM
(#50520368)
I don't think LLMs are as world-changing as the internet, that is a very, very high bar.
They're useful certainly and won't be going away after any financial bubble bursts, whether they are so useful they need to be rammed into every facet of our lives remains to be seen.
One big difference between the internet and LLMS - people enthusiastically adopted the internet and found all sorts of uses for it. LLMs companies are mandating usage by employees and trying to force end users to use it, which seems really strange, why would they have to do that if it's so useful?
Re:Nvidia Was in Trouble Before the Jensen Huang Mess
by bluegatty on Monday November 16, 2026 @12:55PM
(#50520563)
AI will have about 'on par' affect as the Internet.
Companies are 'mandating' use of AI because they see the potential in it.
In 1997, people were not sophisticated enough to grasp how broad the web would be - if they did - managers would have been pushing everyone to adopt the browser and email.
That said, in the 1990's they were actually pushing everyone to adopt 'Windows' etc..
We have a better grasp of how tech affects the economy, and so now there's a lot of hype. Probably too much.
AI is just in 'Phase 1'. The current Chat Bots are basically like the 'Commodore 64' - a 64K computer.
The hype is annoying - I use AI all day and find it useful and drives me crazy but at the same time 'it's real at the baseline'.
It will not 'explode' I think any time soon, it's going to take years, but in 5 years we will look back and see a huge amount of change.
In 5 years, up to 1/2 of AWS services will be AI based for example. All sorts of new features.
An example: RAG is being embedded into most DBs now, that's a big deal and taht's just 'embedding' not even really AI. In a few years, regular 'javascript jockeys' will be used to that kind of thing.
I'm by no means AI-pilled, and I'm skeptical of all these shenanigans ... but 'it's real'. This is happening on about the scale of the Web Browser.
Re:Nvidia Was in Trouble Before the Jensen Huang Mess
by grey-area on Monday November 16, 2026 @03:45PM
(#50522999)
I really don't think we can say what impact LLMS will have yet - AI is such a broad term and is much broader than the LLM craze, which is very specific and led to this dramatic demand for GPUs.
AI has already had a massive impact (machine learning to recognise pictures, spot patterns in data etc) and will continue to do so.
We're talking about LLMs here and the huge amount of money that has been pumped into them by companies like Nvidia in circular deals with their customers. Personally I think the jury is still out on whether LLMs will develop much further than they have. Comparing Opus 5.5 to Fable 5.2 this week I've seen little difference. We'll see in time though.
Re:Nvidia Was in Trouble Before the Jensen Huang Mess
by seizethecheese on Monday November 16, 2026 @01:55PM
(#50521387)
Excellent point. I would guess gold mining profit for Caterpillar is similar now than selling shovels to gold rush in 1849 though. Point being, Nvidia may grow revenue 5x during that margin compression.
Re:Nvidia Was in Trouble Before the Jensen Huang Mess
by bryanlarsen on Monday November 16, 2026 @02:34PM
(#50521934)
Given that Nvidia currently has ~80% market share, that implies the whole market also has to grow 5x. And if Nvidia starts losing market share to their equivalent of Komatsu, Volvo, John Deere etc, then that means market growth of 20x or more. I don't see it.
Re:Nvidia Was in Trouble Before the Jensen Huang Mess
by usefulcat on Monday November 16, 2026 @01:06PM
(#50520709)
I don't think anyone here is claiming that LLMs will go away. However I do think there are probably a lot of opportunities for commoditization around LLMs, and if/when that happens it will signal an end to the "gold rush" days.
Re:Nvidia Was in Trouble Before the Jensen Huang Mess
by bluegatty on Monday November 16, 2026 @03:27PM
(#50522741)
I think a lot of people do think somehow it will go away aka the individual I Was responding to.
I don't think demand for Frontier AI will go away either - even as in the near future 90% of AI will be 'commodity AI' - the Frontier foundries will still have competitive differentiation to offer.
Just like SaaS - technically almost all SaaS should be 'commodity' ... and yet it's not.
I think we can all agree that we are 'sick of the hype' but that doesn't mean the engine will diminish.
Re:Nvidia Was in Trouble Before the Jensen Huang Mess
by mock-possum on Tuesday November 17, 2026 @04:24AM
(#50529250)
Look for pick sellers who are well positioned to pivot to something else. What could manufacturers do if video cards (or SSDs, or RAM) are no longer needed for AI?
Re:Nvidia Was in Trouble Before the Jensen Huang Mess
by SecretDreams on Monday November 16, 2026 @12:28PM
(#50520195)
Common saying. I always wonder how the stock market would have priced pick sellers? Would they have baked in 10 years of continued revenue growth from the sale of picks?
Re:Nvidia Was in Trouble Before the Jensen Huang Mess
by The-Bus on Monday November 16, 2026 @03:06PM
(#50522428)
Look at Cisco. Only this year did its stock return to the price it reached at its peak in 2000. Since then the amount of people on the internet has grown ten-fold.
Re:Nvidia Was in Trouble Before the Jensen Huang Mess
by MisterMunchkin on Tuesday November 17, 2026 @02:58AM
(#50528685)
You want to be selling picks, but you don’t want to be buying pick sellers, because they’re selling at overly inflated valuations because of their one-off business.
Re:Nvidia Was in Trouble Before the Jensen Huang Mess
by nostrademons on Monday November 16, 2026 @12:38PM
(#50520314)
It does make me wonder if this is a concerted press attack by short sellers.
All the stuff about Jensen's affairs, NVidia sales to China, circular financing, increasing competition in the market, etc. was known months ago. Indeed, much of it came out in research notes by major short-selling funds. And NVDA is an extremely attractive target for shorts, having been bid up high by the AI bubble and then having a lot of retail interest that could easily be pushed the other way. Entirely possible that certain funds have taken a large short interest and are now trying to give it that push to profit.
Re:Nvidia Was in Trouble Before the Jensen Huang Mess
by bluegatty on Monday November 16, 2026 @02:14PM
(#50521660)
I will agree it seems like a lot but
1) short sellers do not control the press. The best they can do is material leaks, like those 'Heisenberg' or whtever research companies, but you have to drop a real bomb for that
2) Trump is generally pro Jensen and most of the Cabinet and tech people are, and Dems don't have a specific fight with him
3) Jenses is not a likely face of 'tech evil' like Musk could be.
Most likely what you are witnessing is how ugly and nasty the press can be.
I've seen so, so many articles fro 'resepectable news outlets' with tawdry and slacious headlines - and almost no real information.
The 'timeline' of Mega Speed ? Had to go to AI to find it, and it's far more nuanced than what the headlines are saying.
The press loves waves and hype - it brings them revenue.
I think there is pent up anti-AI populism and the Jensen story was just the thing to pop first.
So he got it.
Also - the news just kept leaking aka 'yet another woman he slept with' so that kept the story alive.
There also might be things we don't know aka stuff that the Board has been made aware of that we don't know.
I think it's sad because I think Jensen is a reasonable and decent person that owes an apology to his wife, and not really anyone else.
Re:Nvidia Was in Trouble Before the Jensen Huang Mess
by dcss_gardener on Monday November 16, 2026 @03:54PM
(#50523109)
I think it's an underreported detail in the english language press & internet that openai and anthropic are visibly lobbying to get the US government to ban open weight models or de facto make them difficult or impossible to use.
And Huang was by far the most powerful person outside of china taking the other side of that. I'm not going full conspiracy here, I genuinely don't think it was necessarily a coordinated takedown or anything like that. But if you look at whose public positions incentivize them to rile people up around this it is definitely worrying.
If you read amodei's remarks over the last few years he very clearly considers llm development to be a US vs china cold war 2 type deal that justifies dramatic action that would otherwise be morally abhorrent.
Now here's the conspiracy brain part. Say you're ideologically committed to inhibiting chinese labs' ability to develop open models, and willing to do anything short of literal bloodshed for it. We know tech companies consider manipulating public sentiment for their own purposes to be within the bounds of fair play. And in this hypothetical you have unlimited unrestricted access to claude mythos. What could you do with it?
Re:Nvidia Was in Trouble Before the Jensen Huang Mess
by vb-8448 on Monday November 16, 2026 @04:51PM
(#50523834)
> I'm not going full conspiracy here, I genuinely don't think it was necessarily a coordinated takedown or anything like that.
Unless it's some 4d chess tactic, the timeline doesn't have much sense, the ANT IPO is paying for this takedown.
And generally speaking, if you want to control you adversary you try to "leak" tech and information in order to control how much and what exactly he knows. Going full ban doesn't make any sense in the long term.
Re:Nvidia Was in Trouble Before the Jensen Huang Mess
by Foobar8568 on Monday November 16, 2026 @02:25PM
(#50521816)
Epstein files, the American soldier who was arrested in UK for spying for Russia (https://www.bbc.com/news/articles/c6d7q77xgw0vo ), the blue wave, and I am sure I am missing a few others.
Re:Nvidia Was in Trouble Before the Jensen Huang Mess
by joe_the_user on Monday November 16, 2026 @01:00PM
(#50520643)
Nvidia's chip business seems certain to survive. They have also made themselves an "AI financing company" and the question is whether that enterprise could sink the Nvidia the corporation. Notably, Nvidia has "$530 billion in gross off-balance-sheet guarantees..." [1]. Nvidia total capitalization is 3.77 trillion and its yearly revenue is 200-300 billion. As long as things chugging along, the chip business can support the finance business but if you have a sudden shortfall, things may be tighter.
Re:Nvidia Was in Trouble Before the Jensen Huang Mess
by grey-area on Tuesday November 17, 2026 @02:28AM
(#50528515)
In the long term EMT is roughly accurate. In the short term, it doesn’t describe the market, which is prone to panic and delusion. It overshoots in both directions.
Re:Nvidia Was in Trouble Before the Jensen Huang Mess
by sigmoid10 on Monday November 16, 2026 @11:25AM
(#50519388)
People have claimed that competitors are catching up for a long time. But these journalists never understood why Nvidia was so dominant. And it seems they still don't. The Jensen story only made investors unhappy because of the high volatility and uncertainty. Noone who's well informed dumped Nvidia because of technological fears of competitors.
Re:Nvidia Was in Trouble Before the Jensen Huang Mess
by madaxe_again on Monday November 16, 2026 @12:12PM
(#50519983)
To be fair, ram really is cyclical, and a commodity.
The Nvidia ecosystem… not so much. Most all of these pieces fail to recognise their already dominant position in the edge inference space - and most all of these pieces fall into the trap of AI=LLMs=ChatBots, and really, who wants to chat with a computer any more.
I don’t mind. This has been a great week to stock up on the equity, and there was enough blood in the water before the salacious spy sex story that I bought a bunch of very, very cheap $150 puts, as hysterical overreaction is the plat du jour, which I sold on Thursday.
Re:Nvidia Was in Trouble Before the Jensen Huang Mess
by Danox on Monday November 16, 2026 @12:22PM
(#50520096)
Nvidia biggest problem going forward they aren’t as versatile now essentially a one trick pony and now that they don’t have their CEO, they will be rudderless. That latest team up with Microsoft was a dud and a bean counter CEO isn’t gonna be able to fix that.
Re:Nvidia Was in Trouble Before the Jensen Huang Mess
by bryanlarsen on Monday November 16, 2026 @11:33AM
(#50519510)
OTOH developers keep confusing R&D vs production. Nvidia is going to keep its dominance in R&D. But the vast majority of Nvidia chips are used for training and inference. Using Nvidia for that saves you 3 days of work porting from R&D to production.
Re:Nvidia Was in Trouble Before the Jensen Huang Mess
by leptons on Monday November 16, 2026 @01:15PM
(#50520838)
Maybe they wouldn't be the laughing-stock of AI if someone better than Tim Cook was leading them. Siri is pretty bad, "Apple Intelligence" is a misnomer.
Re:Nvidia Was in Trouble Before the Jensen Huang Mess
by georgemcbay on Monday November 16, 2026 @04:01PM
(#50523211)
Apple is currently the most valuable company in the world and unlike many of the companies that aren't "laughing-stock of AI" it actually has a defensible moat for its products for the foreseeable future.
I'm generally not an Apple customer at all (I own an old Mac Mini to do occasional iOS development, but rarely use it), but think they are a better bet long term than any of the AI labs.
Re:Nvidia Was in Trouble Before the Jensen Huang Mess
by leptons on Monday November 16, 2026 @11:24PM
(#50527412)
Tim Cook did not make Apple the most valuable company, they are still riding the coattails of the reality distortion field eminating from Steve Jobs grave.
Re:Nvidia Was in Trouble Before the Jensen Huang Mess
by empath75 on Monday November 16, 2026 @11:29AM
(#50519450)
There's a simpler explanation for the stock price drop here. The price had almost gone up 5x in five years, and bad news caused people to stop and take profits. You don't have to assume their business model is bullshit or that the AI bubble is popping or that there is fraud to justify a 10% pull back after a run up like that.
There's so much projection and wishful thinking about completely normal price movements in hyped stock.
Re:Nvidia Was in Trouble Before the Jensen Huang Mess
by californical on Monday November 16, 2026 @12:17PM
(#50520029)
> bad news caused people to stop and take profits
> You don't have to assume … that the AI bubble is popping
I’m not saying it is, but what is a bubble popping, if not a bunch of people saying “oh this might be the highest we go for now, I’m gonna take my profits”, which causes downward pressure for those who come slightly later who also want to take profits, etc?
The question is just if enough people stop to take profits to trigger that chain reaction. After all, it’s basically the same as saying that the seller thinks the current value in cash is more valuable than the future value of the company, otherwise people don’t really sell
Re:Nvidia Was in Trouble Before the Jensen Huang Mess
by empath75 on Monday November 16, 2026 @03:47PM
(#50523016)
Because people think the stock is worth holding 150 (or 140, or wherever it bounces from) but not at 180. It doesn't need to go _all the way down_. A normal overshoot and correction is not a "bubble".
Re:Nvidia Was in Trouble Before the Jensen Huang Mess
by bagacrap on Monday November 16, 2026 @11:56AM
(#50519776)
Shorting is really really hard. And the end goal of shorting, sure for someone it's self enrichment, but why it's tolerated as a whole is to help identify and pop bubbles before they get out of hand.
Journalists plausibly have the same goal: speak truth to power to protect society. To be an investigative reporter you take on immense amounts of personal risk, and on very rare occasions get a big payoff in terms of recognition and career prestige.
So Wired is "short" Nvidia only in the sense that they benefit from pointing out its problems, and mostly only if they are right and get the timing right, otherwise they just lose status.
Re:Nvidia Was in Trouble Before the Jensen Huang Mess
by wilsonjensen on Monday November 16, 2026 @12:20PM
(#50520071)
Wired is Soylent Green.
It's a legal shield to insulate the real people from having their personal lives destroyed in court; they were just following orders type thing.
I never said shorting was easy; don't put words in others mouths.
Doesn't stop people from trying. This forum is naive af about a the world; there are billions of people who don't know you exist making choices that, like a spider-web, shake the various social webs of people and impact you.
They won't be fitting into your absurd reductionist take on human behavior.
Re:Nvidia Was in Trouble Before the Jensen Huang Mess
by password54321 on Monday November 16, 2026 @12:39PM
(#50520329)
Polymarket says 7% and hasn't budged at all. Jensen looks like he will be returning as well, turns out it was just a coordinated attack from the media.
Re:Nvidia Was in Trouble Before the Jensen Huang Mess
by lenerdenator on Monday November 16, 2026 @11:41AM
(#50519609)
Well, I don't have a subscription to Wired, so it would seem I can't read this, but the lesson I draw from this is that no one person should be so important to your company's value that them making human mistakes drags the stock value down that much. No single human is that smart or that valuable. It's the job of boards to prepare for eventualities like this. Nvidia was in a better position than most to be able to do something about Huang's conduct, but now they're having to make up a succession plan as they go along.
If you own shares in a company like that, you need to evaluate how that can be changed - either your ownership of the shares, or the corporate governance of the company.
Re:Nvidia Was in Trouble Before the Jensen Huang Mess
by bagacrap on Monday November 16, 2026 @11:53AM
(#50519745)
> It's the job of boards to prepare for eventualities like this.
The board is the one who ousted him! I agree that they should have been better prepared, but from the outside this looks like a long-running power struggle. Jensen didn't accidentally wind up with 60 reports. The board finally found an opportunity to correct the issue.
Re:Nvidia Was in Trouble Before the Jensen Huang Mess
by lenerdenator on Monday November 16, 2026 @12:02PM
(#50519855)
To me, this smacks of having to cater to Huang's desire to be the "special boy". The board had actual power over him (a thing that many founders have unfortunately learned since to avoid) but at the same time, they never actually made him sit down and set up a succession plan, and never set up a board president/chairman until last week.
If they had forced him to do either of those things, it might have suggested that he was... replaceable.
Re:Nvidia Was in Trouble Before the Jensen Huang Mess
by lenerdenator on Monday November 16, 2026 @03:35PM
(#50522855)
It shouldn't, but if you look at the filings of both Meta and SpaceX, they both say that a CEO search would take an indeterminate amount of time and be unlikely to satisfy the value proposition of the business. Patrick Boyle just had a video about this on the YouTube.
What we have here are a bunch of boards that can't do anything, won't do anything, or both. SV founder culture is a bunch of people who believe themselves to be the special boy and being completely unwilling to deal with anyone who might tell them otherwise.
Re:Nvidia Was in Trouble Before the Jensen Huang Mess
by LogicFailsMe on Monday November 16, 2026 @12:06PM
(#50519895)
And here I thought the lesson was control 51% of the vote like Zuckerberg, Karp, and Musk do, before letting your freaky flag fly.
But as this situation evolves, the spying allegations were BS which is why nothing moved on it for a year, and it looks like they need him back to manage Asia in exchange for tweaking the org chart and coming up with a succession plan. That org chart that led to his shenanigans is the same one that let him adapt faster than any of his peers. Good luck figuring out the best path forward here.
Re:Nvidia Was in Trouble Before the Jensen Huang Mess
by lenerdenator on Monday November 16, 2026 @01:32PM
(#50521057)
> And here I thought the lesson was control 51% of the vote like Zuckerberg, Karp, and Musk do, before letting your freaky flag fly.
That's the lesson lots of aspiring founders with untreated personality disorders will take from it, yes. The ones who don't are the ones who realize they're human, prone to mistakes, and will want to protect the legacy they've built with a system that constrains them.
Also, can't wait for the downvotes on this one. Every time I suggest that boards should have actual control over the c-suite, particularly founder CEOs, I get downvoted.
Re:Nvidia Was in Trouble Before the Jensen Huang Mess
by LogicFailsMe on Monday November 16, 2026 @02:10PM
(#50521594)
Why would I downvote you when I broadly agree with you in principle? It's just that reality gets in the way and you can either LARP the game you want to play or play the game by its rules.
Re:Nvidia Was in Trouble Before the Jensen Huang Mess
by lenerdenator on Monday November 16, 2026 @03:39PM
(#50522925)
Sorry, I should have clarified. I didn't mean to blame you for the downvotes.
Whenever I post something on here suggesting that perhaps we shouldn't give single individuals complete control over corporations worth trillions of dollars, regardless of whether or not they founded the company, I see downvotes. It makes sense; HN is the discussion forum for YC and my thoughts directly conflict with a sizable portion of the user base here, many of whom want to be the next Steve Jobs, just without the years in the wilderness.
Re:Nvidia Was in Trouble Before the Jensen Huang Mess
by ba1afd89f34cb23 on Monday November 16, 2026 @12:28PM
(#50520192)
Well before any of this happened one report that ranked boards of large publicly traded companies had NVIDIA’s board 609th out of 650 or so, by far the weakest out of peer companies. Their board tenure is more than twice as long as comparable companies (which is not a good thing), and the members do seem to cater towards Huang - such as one of his mentors being on it, who also owns a company being shoveled billions by NVIDIA.
I don’t think the report and rankings should be taken as gospel but it’s an interesting read to consider given the clear failures of the board.
Re:Nvidia Was in Trouble Before the Jensen Huang Mess
by coreylane on Monday November 16, 2026 @11:48AM
(#50519680)
Remember when GPUs were the dominant tech to mine crypto, then ASICs and other spepcialized purpose-built hardware came out and made GPUs irrelevant for mining, wont that also happpen in regards to ai training/inference. like aws is attemppting to do with their trainium/inferentia chips. Sure they suck now, but won't they get better and thus lose the dependency on GPUs?
Re:Nvidia Was in Trouble Before the Jensen Huang Mess
by sanderjd on Monday November 16, 2026 @12:55PM
(#50520562)
I don't know. But my assumption is that they are. The crypto ASIC market was way smaller and less ambitious than this. It would have been just a relatively small cash grab for them to get into that market, whereas this market could represent an actual strategic direction.
Re:Nvidia Was in Trouble Before the Jensen Huang Mess
by hermitShell on Monday November 16, 2026 @11:56AM
(#50519775)
This is why I think their pivot/venture to general robotics was smart. However, I doesn't seem like they will become profitable on that front because they were outcompeted pretty hard in most measures I can conjure.
Re:Nvidia Was in Trouble Before the Jensen Huang Mess
by fc417fc802 on Monday November 16, 2026 @03:35PM
(#50522866)
> there will always be demand for training and SOTA model
Some, but how much? Once you have a mass produced ASIC with a model that's "good enough" much (but obviously not all) of the demand for the cutting edge could evaporate quite rapidly I think.
Re:Nvidia Was in Trouble Before the Jensen Huang Mess
by its-summertime on Monday November 16, 2026 @03:53PM
(#50523097)
Something that could benefit from throughput/Wh but wouldn't benefit from flexibility and being cheaper than using bespoke chips feels like such a narrow set of uses though
Re:Nvidia Was in Trouble Before the Jensen Huang Mess
by notnullorvoid on Monday November 16, 2026 @12:00PM
(#50519825)
It's already happened hasn't it. Google's TPUs are apparently much more efficient at inference workloads. However the hardware isn't available to the public like Nvidia chips are.
I'm unsure about the energy efficiency of Tenstorrent cards, but they are at the moment much more cost effective than Nvidia. But software support is far behind, I suspect if it wasn't the cost would be more equal.
Re:Nvidia Was in Trouble Before the Jensen Huang Mess
by luckydata on Monday November 16, 2026 @12:09PM
(#50519946)
google doesn't use them, they buy them to make them available for google cloud customers that require CUDA or other nvidia-only workloads. All training and inference at Google is done on TPUs.
Re:Nvidia Was in Trouble Before the Jensen Huang Mess
by nostrademons on Monday November 16, 2026 @12:13PM
(#50519997)
Basically capacity issues. NVidia + Apple have bought up a significant portion of TSMC's manufacturing capacity. The primary supplier for Google's TPUs is Broadcom, with TSMC as a second source, and they're trying to ink contracts with other suppliers like MediaTek, but there're only so many semiconductor fabs in the world and TPUs need a fairly modern process.
Within Google itself the TPUs are definitely preferred for AI workloads, you just can't always get them.
Re:Nvidia Was in Trouble Before the Jensen Huang Mess
by joe_the_user on Monday November 16, 2026 @12:36PM
(#50520293)
Broadcom isn't a chip foundry so calling it Google's supplier doesn't make sense. TSMC has been the primary manufacturer of TPUs but Google's hoping to use Samsun and Intel also going forward (and these are the only leading edge foundries in the world). Broadcom is co-developer of the chip.
Re:Nvidia Was in Trouble Before the Jensen Huang Mess
by joe_the_user on Monday November 16, 2026 @04:21PM
(#50523472)
I don't know details at this level but I know that TPUs like GPUs need to be made on the most advanced available nodes and TSMC, Samsung and Intel are exactly the only enterprises pursuing those advanced nodes. The reason is that this is
I mean, Google tell me it's TSMC's 3 and 2 mm process - exactly what you'd expect. But you can Google as well as I can.
Re:Nvidia Was in Trouble Before the Jensen Huang Mess
by basch on Monday November 16, 2026 @12:38PM
(#50520310)
Crazy that a company can use a contract to buy up all the supply to build an inferior product that’s less energy efficient and then sell it at a higher price than the purpose built counterpart. Market failure.
Re:Nvidia Was in Trouble Before the Jensen Huang Mess
by bigyabai on Monday November 16, 2026 @12:44PM
(#50520410)
TPUs are a systolic array. It's not comparable to the hardware architecture that backstops CUDA, nor do they serve the same markets.
The writing was on the wall for TSMC ever since the 5nm node; Apple proved that anyone with enough liquid cash could block competitors from fab access.
Re:Nvidia Was in Trouble Before the Jensen Huang Mess
by simpetre on Monday November 16, 2026 @01:18PM
(#50520881)
Modern NVIDIA GPUs contain tensor cores that are optimised for MMA operations as well though right? The standard CUDA execution path isn’t comparable, but the tensor core path very much is?
Re:Nvidia Was in Trouble Before the Jensen Huang Mess
by Melatonic on Monday November 16, 2026 @02:46PM
(#50522130)
I'm no expert but I think we're dealing with two different ends of the spectrum here. Nvidia GPUs are likely cutting edge within the individual board / processor itself. Their main limiting factor right now seems in effectively networking them together (which is why they bought Mellanox or whatever awhile back to further develop Infiniband).
TPUs are significantly less flexible and I would guess at an individual level not as efficient or fast as Nvidia. But they're designed specifically to be bundled together in large arrays with similarly large data pipes to storage and interconnects to cache, ram and other compute. I would guess Google didn't bother trying to sell them until recently because you needed to be deploying them at large scale for it to be even worth also developing the software for.
What we really need is innovation in super fast (bandwidth and latency) and reliable interconnects. I suspect the days of slotted in GPU and RAM will be over soon and we'll see a move everywhere to pin based sockets (like we've always had for CPUs). Stuff like SXM and LPCAMM
Re:Nvidia Was in Trouble Before the Jensen Huang Mess
by sjs382 on Monday November 16, 2026 @12:53PM
(#50520540)
> Crazy that a company can use a contract to buy up all the supply to build an inferior product that’s less energy efficient and then sell it at a higher price than the purpose built counterpart. Market failure.
They're not buying up "all the supply to build an inferior product". They're buying it up build a different, high-demand product.
Re:Nvidia Was in Trouble Before the Jensen Huang Mess
by nostrademons on Monday November 16, 2026 @12:59PM
(#50520623)
They're not really the same markets. NVidia is selling chips that AI runs on, Google is selling services that use AI. Google's play is to make better services than the competition can because they control the full infrastructure stack, thus preventing their markets from being commoditized. NVidia's play is to commoditize the AI providers so that the number of services expands rapidly, with NVidia chips powering all of them. Arguably it's Google's strategy that is the market failure, as it's designed to keep competition out, but...
Google's used this strategy a few times before, and it frequently doesn't work out. They kept MapReduce and GFS proprietary so they could build better big-data services than everyone else, but Doug Cutting from Yahoo clean-roomed it, and then eventually you had interviewees going "MapReduce? That's like Hadoop, right?" They had a long string of internal ML frameworks well before the rest of the industry (I remember in the '00s and early '10s Google was by far the leader in large-scale machine-learning) but had to open-source TensorFlow in the face of external competition, and then lost in the marketplace to PyTorch because TensorFlow was filled with internal WTFs and footguns needed to support specific Google projects. They had a big lead in datacenter technology over everyone else in the industry in the early 2010s, but kept it internal and proprietary until they were forced to sell it as a service by the huge growth of AWS and Azure, then had to play catch-up as a distant 3rd because they lacked the customer relationships and developer mindshare.
Re:Nvidia Was in Trouble Before the Jensen Huang Mess
by overfeed on Monday November 16, 2026 @01:34PM
(#50521080)
> They're not really the same markets.
Both are fabless customers of TSMC, which happens to be the choke point.
Unlike gp, I do not believe its a market failures as much as the cutting-edge process node bieng a natural monopoly. Once TSMC processes got really good, TSMC started capturing most of revenue dollars and reinvesting them, which made TSMC products even better - a situation that makes it impossible for Samsung or Texas Instruments to catch up. Intel rode on a similar wave for decades
Re:Nvidia Was in Trouble Before the Jensen Huang Mess
by FuriouslyAdrift on Monday November 16, 2026 @01:58PM
(#50521436)
Packaging is the choke point in AI. It's still TSMC but chip production is doing fine. It's the Chip-on-Wafer-on-Substrate build chain that is severly constrained.
Re:Nvidia Was in Trouble Before the Jensen Huang Mess
by Melatonic on Monday November 16, 2026 @02:39PM
(#50522013)
Why is no one going to Intel then for this kind of stuff ? Or even a legacy producer like IBM or Ti ? I would imagine they could buy some slightly older ASML litho machines and make something on a slightly older process (or package it using the older process for the other stuff and just keep the main processor latest gen) ?
Re:Nvidia Was in Trouble Before the Jensen Huang Mess
by rubyn00bie on Monday November 16, 2026 @04:14PM
(#50523370)
From what I’ve read it’s that TSMC is just so much better at it… much higher yields and much more reliable than any of the other fabs. I wanna say something like 2-3 years ago, before Blackwell, NVidia tried to use Samsung for example but had nothing but issues. Intel hasn’t proven its fabs capable of anything really useful in nearly a decade.
I think even if you have the capital to acquire something from ASML… by the time it’s setup and tuned correctly TSMC will likely have enough capacity to eat your lunch. If it takes 2-3 years to get a fab online TSMC will likely have a new node and their old ones will be available.
TSMC has really proven over the past 5-10 years that the fab is its own beast and requires its own immense level of expertise and investment. When you have the worlds largest chip companies shoveling all their manufacturing dollars through one single org, that seemingly does the right thing, it’s going to be pretty much impossible to beat them.
Re:Nvidia Was in Trouble Before the Jensen Huang Mess
by Kirby64 on Monday November 16, 2026 @06:35PM
(#50525165)
> Why is no one going to Intel then for this kind of stuff ? Or even a legacy producer like IBM or Ti ? I would imagine they could buy some slightly older ASML litho machines and make something on a slightly older process
Literally TI even uses TSMC for the digital only stuff they do. The investment for these cutting edge nodes (or even, not so cutting edge. Like say, 10nm) is absurd vs the payoff.
Re:Nvidia Was in Trouble Before the Jensen Huang Mess
by nostrademons on Monday November 16, 2026 @03:36PM
(#50522883)
BigTable and MapReduce are differennt use-cases. The former is a database; the latter is a framework for running batch jobs. The (internal) successor to MapReduce is Flume (2010), which is quite a bit more capable, but didn't come out until Hadoop was already well-established. The external equivalent is Apache Spark (2009), but the gap between internal and external technologies had already shrunk to be nearly indistinguishable by then.
Re:Nvidia Was in Trouble Before the Jensen Huang Mess
by joe_the_user on Monday November 16, 2026 @03:38PM
(#50522909)
It's logical that company like TSMC sells capacity to the highest bidder.
The main thing is that chip manufacturing is the most highly capitalized industry in the world. Each manufacturing step has gargantuan costs and so no company wants to manage (and pay for) all the steps - so TSMC buys chip manufacturing equipment from ASML and sets up a system where corporations buy capacity. It's essentially a very, very, very expensive print shop. The print shop doesn't make its own printers nor it print a newspaper.
And naturally, with very, very objects like leading-edge chips, "inferior" or "superior" is a ridiculous simplification. Nvidia chips are incredibly powerful and useful. Nvidia has been more committed than any other company to general purpose GPU programming.
But Nvidia also is doing it's best to sell at high, monopoly prices. That's why they buy a lot of capacity. The thing about the situation is these companies did spend a lot of money reaching this monopoly situation so from their viewpoint, this monopoly pricing might be fair. But I personally wouldn't care and hope some regulation stops it. But that kind of regulation would still have to get these companies significant profit on these investments, so they'd keep making them.
Re:Nvidia Was in Trouble Before the Jensen Huang Mess
by ulfw on Monday November 16, 2026 @08:37PM
(#50526287)
How is it crazy?
If I come to a coffee supplier and say I can pay 50$ for a sack of coffee but I don't know how many I can buy yet as I am building up my coffee shops around the country and then Starbucks comes in and says we are willing to pay 55$ and pay ALL your capacity guaranteed, today, just sign here.
Where do you think most coffee sellers would sign?
Re:Nvidia Was in Trouble Before the Jensen Huang Mess
by Melatonic on Monday November 16, 2026 @02:37PM
(#50521982)
Interesting. What manufacturing process is Broadcom producing them at ? I'm guessing they're not newly as small (lithography wise) as the best of the best yet but probably good enough
Re:Nvidia Was in Trouble Before the Jensen Huang Mess
by rubyn00bie on Monday November 16, 2026 @04:17PM
(#50523424)
Broadcom is just a chip designer or “mercenary” as I read the other day. TSMC is still the fab for most of the TPU, with Mediatek, and Intel used for auxiliary/supporting components.
Re:Nvidia Was in Trouble Before the Jensen Huang Mess
by lizknope on Monday November 16, 2026 @05:31PM
(#50524390)
> The primary supplier for Google's TPUs is Broadcom, with TSMC as a second source
You've got it all mixed up.
Google designs the TPU in partnership with Broadcom. Many companies will write the Verilog RTL and then send this to another company like Broadcom to do the physical design and turn the Verilog along with lots of other IP blocks like serdes into GDS mask data.
Broadcom does not have any fabs. They send that GDS mask data to TSMC to manufacture the chip just like Nvidia, Apple, and tons of other companies.
I'm a physical design engineer if you have any questions.
Re:Nvidia Was in Trouble Before the Jensen Huang Mess
by hrncn on Monday November 16, 2026 @12:24PM
(#50520130)
You have basically managed to sum up why NVDA keeps dominating, no on can "just buy a few TPUs" and that has been the case since the first TPUs were announced years ago (yes yes GPU shortages and so on, but no one questions general availability of GPUs), and the current Tenstorrent model support page looks like an invitation to beta test HW that might (or might not) be able to run current and future models at some point.
But the next gen of Tenstorrent HW looks great on paper - problem is, I could have written that before the current gen was released.
All of the allegedly competing HW looks like that and has looked like that for years, either a lack of availability, capability, or both.
Re:Nvidia Was in Trouble Before the Jensen Huang Mess
by rtkwe on Monday November 16, 2026 @01:02PM
(#50520675)
Are they modifiable after creation? If not that seems dangerously rigid until we reach a much more stable place with LLMs. It could be great for well worn architectures and models but building one now for LLMs seems like it'd be foolish when it'll be outdated in a few months.
Re:Nvidia Was in Trouble Before the Jensen Huang Mess
by fc417fc802 on Monday November 16, 2026 @03:29PM
(#50522777)
The better question is, would someone be able to turn a profit offering a deepseek chip for a few hundred dollars? I wouldn't even care about the energy draw (within reason) having that running entirely locally at better than a few hundred TPS without going bankrupt to obtain VRAM would be a game changer.
Re:Nvidia Was in Trouble Before the Jensen Huang Mess
by lbreakjai on Tuesday November 17, 2026 @07:50AM
(#50530706)
Dangerously rigid, or delightfully stable? The latest consumer models from claude and openAI are already good enough for so much, if they could run locally with minimal power usage.
Re:Nvidia Was in Trouble Before the Jensen Huang Mess
by Melatonic on Monday November 16, 2026 @02:36PM
(#50521960)
Google has two different types of TPUs now. One for inference and one for training.
Do we actually know they're more efficient per watt or for the power used and heat produced ? Or are they just easier to scale (and manufacturer) en masse ?
There's also the CUDA moat which is hard to get around
Re:Nvidia Was in Trouble Before the Jensen Huang Mess
by jordanb on Monday November 16, 2026 @04:26PM
(#50523520)
Cuda is a moat for traditional data science, where you have a torch model and you want to easily run it on a GPU. CUDA is the happy path for doing this.
Nvidia's moat for LLMs isn't Cuda, it's installed capacity, arrangements with frontier labs, TSMC bandwith, and just the fact that it currently has no real competition.
Re:Nvidia Was in Trouble Before the Jensen Huang Mess
by yubblegum on Tuesday November 17, 2026 @08:18AM
(#50530961)
Various articles recently claimed most of the NVIDIA deals are "handshakes with Jensen".
This Huang scandal has so many dimensions that are clearly more impactful on the world outside than to NVIDIA itself -- the blast radius seems to extend to the US cabinet -- that it begs questions if Jensen Huang wasn't id'd as the essential piece to remove to affect a comprehensive restructing in the segment.
So if deals fall apart because Jensen and his handshake have left the room, that may unclog many memory and processing supply lines that are currently spoken for by deals with Jensen. That may have been a goal from the start.
Re:Nvidia Was in Trouble Before the Jensen Huang Mess
by genxy on Tuesday November 17, 2026 @11:15AM
(#50533564)
So the GPUs were a cherry on top, the real target was removing Huang? And Jensen huang'd himself by making himself the brittle link in a chain (his handshake deals being a big one).
Re:Nvidia Was in Trouble Before the Jensen Huang Mess
by cyberax on Monday November 16, 2026 @05:45PM
(#50524557)
CUDA is useful if you want a human expert writing new experimental kernels, perhaps while testing different algorithms.
But once you do that, translating CUDA into one of many available vectorized backends is trivial.
We have a bunch of custom kernels for geometric operations (like merging polygons) and they were rather difficult to write a while ago. AI rewrote them in HIP during my lunch break.
Re:Nvidia Was in Trouble Before the Jensen Huang Mess
by 14113 on Monday November 16, 2026 @05:00PM
(#50523979)
Modern NVIDIA cards are essentially TPUs - especially those spec'd out for AI data centres. TPUs aren't anything particularly special - they are just large vector processors, with hardware specialised for the data + instruction fetch patterns that are seen when running AI models. The graphics cards that NVIDIA sells for data centres are just large vector processors with hardware specialised for the data + instruction fetch patterns that are seen when running AI models.
Re:Nvidia Was in Trouble Before the Jensen Huang Mess
by bigyabai on Monday November 16, 2026 @12:23PM
(#50520118)
Not to mention, many ASICs were outclassed by a few well-tuned GPUs in terms of power-efficiency. There were only a few coins that bucked that trend, usually just altcoin/shitcoin experiments that weren't worth mining in the first place.
I'm kinda bewildered, it's bizarre seeing people cheer on quickly-obsolete accelerators instead of demanding their OEM to adopt GPGPU. CUDA will be relevant for much longer than any ASIC can ever be, even (or especially) if the transformer gets replaced overnight with a better architecture.
Re:Nvidia Was in Trouble Before the Jensen Huang Mess
by rcxdude on Monday November 16, 2026 @12:46PM
(#50520436)
Cerebras don't need to customise their chips. To my knowledge they are crazy fast but struggle to fit larger models and it's not clear they're economically favourable.
Ethereum's work function was designed to be memory bandwidth limited, which is something gous are already quite well optimised for. An asic would be faster but not by enough to be worth the investment, at least while gpu margins were less crazy.
The main thing is the actual number crunching and memory interfaces for LLMs are not crazy hard to implement, and the potential scale is huge, so NVIDIA's moat is not likely to be big enough to make their current margins sustainable in the longer run.
Re:Nvidia Was in Trouble Before the Jensen Huang Mess
by velospeed2002 on Monday November 16, 2026 @04:30PM
(#50523576)
Yes, ASICs are application-specific e.g. "fixed". But, I think it's possible to target algorithm implementation that is inherently flexible, only limited by HW constraints (bit widths, RAM depth, etc) and thus cost. Yet, still fully pipelined and much higher performance than alternatives.
My background is ASIC design and more recently 3rd-party IP development for integration into ASICs. In our last design I made heavy use of resource sharing (RAM and holding regs for intermediary values, counters, LUTs, complex multipliers, adders, etc, even state machines).
That got the wheels turning. I believe such an approach can be generalized to support a wide range of computation and thus algorithm development. Even state machines can be configurable if designed that way. All controllable by programmable registers.
Just don't look for AI to take on such a task. Or go ahead and try, it already fails miserably when it comes to RTL design (verilog, vhdl). LOL
Re:Nvidia Was in Trouble Before the Jensen Huang Mess
by KeplerBoy on Monday November 16, 2026 @12:15PM
(#50520008)
To be fair GPUs have already changed a lot in response to the AI demands. A lot of silicon these days are tensor cores which have very few applications outside of deep learning.
Re:Nvidia Was in Trouble Before the Jensen Huang Mess
by ChainOfFools on Monday November 16, 2026 @12:30PM
(#50520219)
There are also the opposing architectural directions to extend toward:
one in the "Cerebras" direction of ever-larger scale general purpose HPC silicon running inference workloads. Cerebras may have skipped ahead to the last act of that scaling story, notwithstanding any further wafer-diameter enlargements past 300mm. Whether the ending is happy or not is still unclear. Lot of iterative room to grow into it further and they have a formidable patent moat waiting for conventional die-sized AI semi vendors when they inevitably run up against limitations of single-die designs.
the other is in the "Taalas" direction of freezing a specific model into something like high speed ROM / FPGA and getting orders of magnitude inference speed improvements - for that specific model. Like Cerebras, Taalas may also have jumped directly to the architectural telos of that philosophy, with only iterative improvements in cost per work unit left to grind, though like CBRS quite a lot of grinding left to do especially in getting cost per custom tapeout down to near-disposable (hopefully, recyclable) levels.
Re:Nvidia Was in Trouble Before the Jensen Huang Mess
by IAmGraydon on Monday November 16, 2026 @12:32PM
(#50520244)
Mining ASICs are bound to a single cryptographic hashing algorithm, meaning they do one thing and they do it very fast. Something similar may make sense for running models locally, but I believe the more multifaceted Nvidia chips make more sense for training.
Re:Nvidia Was in Trouble Before the Jensen Huang Mess
by IAmGraydon on Monday November 16, 2026 @03:06PM
(#50522423)
>This also may not matter when models all start to converge on a 'good enough' level of coverage for specific domains that the chips can remain productive for 3-4 years before needing a recycle.
Yeah I was thinking this will probably be the case. We may eventually settle into a slower release schedule as well, where a new model only comes every year or two.
Re:Nvidia Was in Trouble Before the Jensen Huang Mess
by FrustratedMonky on Monday November 16, 2026 @12:34PM
(#50520269)
Yes. Half dozen companies are designing special chips to bypass/replace the GPU.
Bitcoin was lucky for Nvida, the AI was lucky. Third times the charm?
On other hand, luck favors the prepared. Beyond luck, they did make their chips accessible, easier to program than other GPU's. So bitcoin miners and then AI could utilize them.
There are still a lot of people that want to run regular liner algebra.
Re:Nvidia Was in Trouble Before the Jensen Huang Mess
by officeplant on Monday November 16, 2026 @01:04PM
(#50520696)
>Bitcoin was lucky for Nvida
Nvidia cards were the worst hashrate/purchase price of any cards. AMD were the lucky ones there if you consider anyone lucky in this situation. Consumers definitely weren't lucky because the GPU market hasn't recovered since the Etherium boom.
Re:Nvidia Was in Trouble Before the Jensen Huang Mess
by mcbuilder on Monday November 16, 2026 @01:17PM
(#50520864)
I think things changed, in the early days of BTC AMD (ATI at the time) was king. Later GPU made a comeback with Nvidia rigs doing well during Ethereum era.
Re:Nvidia Was in Trouble Before the Jensen Huang Mess
by officeplant on Tuesday November 17, 2026 @09:05AM
(#50531557)
Even in the later ethereum era everyone I know just had mining rigs full of RX480's since they were the cheapest 8GB cards (Before that banks of AMD 280X gpus until they didn't have enough VRAM). Then most people I know that were seriously into crypto quickly moved on to ASICs and sold off their GPU rigs.
I imagine the 1070/1070ti 1080/1080ti were decent at mining, but a lot more expensive to obtain for these gpu mining rigs with 6-10 gpus in them.
Re:Nvidia Was in Trouble Before the Jensen Huang Mess
by ChainOfFools on Monday November 16, 2026 @12:51PM
(#50520507)
Whats amazing is that this is around 5x faster than the top end Cerebras wafer-scale silicon, at much less power/cooling cost per token. Of course Cerebras is a general purpose design, but perhaps Taalas could license CBRS wafer-scale patents to create a single monster chip that held either a single massive trillion parameter-scale model, or could an MoE design with a half dozen smaller specialized models on the same wafer with a shared SRAM pool.
I wonder if cooling such a beast, with very non-uniform hot spot distribution, would be too complicated to bother with though.
Re:Nvidia Was in Trouble Before the Jensen Huang Mess
by throwaway63467 on Monday November 16, 2026 @12:49PM
(#50520482)
NVIDIA GPUs stopped being GPUs a while ago, that didn’t happen for crypto, but now it seems the will drop the entire customer graphics market long term they just haven’t committed themselves to it. They can’t go back to GPUs anyway there are not enough gamers to reach the revenue numbers they need now and soon their revenue will be irrelevant.
Re:Nvidia Was in Trouble Before the Jensen Huang Mess
by bigyabai on Monday November 16, 2026 @12:54PM
(#50520548)
Nvidia has multiple B2B customers that require the consumer graphics featureset, like Nintendo. There's sufficient motivation in keeping the GPGPU/raster capabilities on the same card even if PC gaming dies as a market.
Re:Nvidia Was in Trouble Before the Jensen Huang Mess
by TacticalCoder on Monday November 16, 2026 @01:09PM
(#50520762)
> NVIDIA GPUs stopped being GPUs a while ago, that didn’t happen for crypto
But Bitcoin mining moved GPUs to ASICs many many many years ago and Ethereum switched from proof-on-work using GPUs to proof-of-stake: GPUs are pointless now for Ethereum. And Ethereum was the big one for GPU mining. All the others cryptocurrencies are too tiny to register.
Ethereum switching from proof-of-work to proof-of-stake has been the death blow to GPU mining at scale. I'm not saying some have not been profitable mining other less important coins: I'm saying the market for GPU mining shrank to next to nothing.
Re:Nvidia Was in Trouble Before the Jensen Huang Mess
by __MatrixMan__ on Monday November 16, 2026 @12:55PM
(#50520577)
Inference, yes, see https://taalas.com/ and https://chatjimmy.ai/ As expected, efficiency boost is extreme. But you've got to pick the model you want to enshrine in silicon months before you actually get that silicon (and maybe there are additional difficulties if the model is large. Maybe in a few years everybody will just want to use the same four or five models, with no tectonic shifts on the horizon. Then it'll be a no-brainer to make ASICs for those models.
Training? I'm not so sure. You need something flexible so that it can be trained. Burning the weights into the board is the opposite of that.
Re:Nvidia Was in Trouble Before the Jensen Huang Mess
by caxap on Monday November 16, 2026 @01:33PM
(#50521070)
As much as I love the idea of Taalas, their chatjimmy demo is a hard-wired (and probably very quantized) 8b LLM producing garbage extremely fast (17k tokens/s). Extrapolating from the picture of their PCIe board in their demo, I would expect a frontier model to require an IC not smaller than my desk.
At these dimensions, you are better off producing general-purpose inference ICs that can run any model, instead of baking in a single fixed LLM.
Re:Nvidia Was in Trouble Before the Jensen Huang Mess
by Melatonic on Monday November 16, 2026 @03:25PM
(#50522698)
I read into Taalas when they first were putting out info and they also are wiring up massive CPU cache to the thing. It's not just the burned in models.
Re:Nvidia Was in Trouble Before the Jensen Huang Mess
by m4rtink on Monday November 16, 2026 @01:23PM
(#50520940)
So will people buy gaming GPUs fron Nvidia again after how if abused them this time ? Or will the AI obsession be their downfall & example for others what not to do and how not to alienate the customers who get you where you are now?
Re:Nvidia Was in Trouble Before the Jensen Huang Mess
by TheAlchemist on Monday November 16, 2026 @03:34PM
(#50522846)
Yeah, that's my thesis since the beginning of this madness. I see it as a temporary blip (albeit it's already much much longer than I would expect !) and once the bubble pops, Nvidia will be back to their normal cruising speed. Which is a good company, making great products, but their valuation will be 1/10 of what it is now.
And if the boom continues, there is no way either that their clients won't develop a product of their own. It just doesn't make sense to buy chips by the 10s of billions $ on which Nvidia makes >50% margin.
Re:Nvidia Was in Trouble Before the Jensen Huang Mess
by cmrdporcupine on Monday November 16, 2026 @03:55PM
(#50523127)
If you look at the sessions from 2026's "Hot Chips" there's like a dozen competitors and possibilities and new architectures and the like, yes. Some very compelling. And OpenAI and Google and others are also making their own chips.
The thing is, it's only NVIDIA really that has a proven product in high volumes pumping through TSMC with the existing software stack that the community has already proven. That's a huge difference. Everything else is riskier if you're building out in volume. For now.
Relevent article from september 26. To me it’s obvious gpu are a « first response » solution. But I think nvidia can sell a lot before AI R&D slow down (because of the demand or the tech, infra, energy… or whatever reason it will be)
Re:Nvidia Was in Trouble Before the Jensen Huang Mess
by lizknope on Monday November 16, 2026 @05:39PM
(#50524486)
All of the hyperscale data center companies have their own AI chips and their own CPUs as well. They don't want to be dependent on Nvidia (or AMD or Intel)
They still buy Nvidia and x86 chips but this is what the WSJ article from last week was saying. The hyperscalers are moving away and Nvidia is committed to TSMC wafer orders.
Re:Nvidia Was in Trouble Before the Jensen Huang Mess
by davesque on Monday November 16, 2026 @06:08PM
(#50524884)
Apples and oranges, really. SHA-256 is a fixed function with no memory. So it lends itself to being hardwired into pure logic. A CPU or GPU was absurdly wasteful for it. That's why ASICs saw like 100x gains over general purpose hardware. Most of the repeatable tasks in AI workloads, like matrix and vector math at reduced bit widths, have already been encoded into hardware in modern GPUs.
TLDR: LPUs are very efficient, quite a lot more efficient and faster tok/s/u than anything else at this years Hot Chips.
It's my personal opinion that with the way models change you don't want silicon that is too specialised but it needs to be specialised enough. LPUs are designed to strike this balance such that they remain flexible if model architectures change drastically.
Re:Nvidia Was in Trouble Before the Jensen Huang Mess
by justinc-md on Monday November 16, 2026 @02:14PM
(#50521667)
What's your opinion of high bandwidth flash? It seems ideal for storing and retrieving model weights. Do you see that dramatically changing inference chip design over the next couple of years?
Re:Nvidia Was in Trouble Before the Jensen Huang Mess
by jpgvm on Monday November 16, 2026 @09:28PM
(#50526649)
I think anything that doesn't compete with HBM for wafers will get it's day in the sun somewhere.
I don't know if HBF in particular is going to be huge but it's just so hard to predict the future in this space.
My personal opinion is we should be paying attention to SerDes and base dies to keep compute flexible and able to adapt to whatever memory and storage solutions are not supply constrained.
Re:Nvidia Was in Trouble Before the Jensen Huang Mess
by buildbot on Monday November 16, 2026 @03:26PM
(#50522718)
In my personal opinion as well "specialized enough" chips are exactly the right way to go - though disclaimer, also At Nvidia, working on spec dec/external drafts :)
Re:Nvidia Was in Trouble Before the Jensen Huang Mess
by jmyeet on Monday November 16, 2026 @01:10PM
(#50520778)
I don't agree with this.
One of Tim Apple's [sic] big innovations was to take Apple's giant pile of cash and use it for vendor financing. Building a new fab or process or factory is expensive. Borrowing money is expensive and risk. But Apple gave favorable terms in exchange for a period of exclusivity to whatever the vendor produced. This was huge for the iPhone for years.
NVidia is kind of in that position now. One can say that there is circular financing between NVidia and the big AI companies but is it really that different to Apple's approach? I'm not entirely convinced that there's an imminent domino effect collapse coming as a result of all of this. And, even if it does, I don't see it taking down NVidia.
Boeing (and Airbus) is the other company NVidia reminds me of. The business of selling planes is complicated. Boeing gets to throw its weight around and demand concessions. Launch partners for new planes get favorable delivery dates but that's also a chain. Qatar Airways famously went to war with Boeing and lost its A321 orders. That's the kind of power NVidia has now over the AI providers. It gets to decide who gets to buy and when.
As for competitors, there are always wannabees. Remember the decade of Google killers? I do. What happened to them all?
It surprises me on HN of all places how many people think you can vibecode a GPU competitor to NVidia, basically. I'm sorry but no. Chip design is harder than that. Managing relationships with suppliers, vendors, the fabs (particularly TSMC), etc is hard. NVidia has been doing it a long time, has a lot of built up expertise and has a lot of volume and weight it can throw around.
Jensen Huang was correct about China (IMHO). Restricting the chipmaking from ASML is one thing. Restricting the chips was a mistake in foreign policy terms. It has created captive domestic demand for Chinese chips. And it's too late to unring the bell. Xi Jinping realizes that chipmaking and AI is of national security interest to China. Yes there'll be some smuggling in the meantime but I fully expect China's EUV to be producing commercial chips by 2030. China simply doesn't want to be beholden to Western companies in the exact same way that most US tech companies were banned in China. I believe history will vindicate Xi's long-term strategic thinking in this area (yes, blocking the likes of Facebook and Uber predated Xi, I know).
I also think AI isn't going to be ASICed anytime soon like crypto mining was. Crypto had a fixed algorithm. AI does not, at least not yet. It's constantly changing. Even in recent years we've tried different quantization methods (eg fp4, int4). Model architecture is still evolving at a rapid rate. It's way too early to fix that into hardware.
Re:Nvidia Was in Trouble Before the Jensen Huang Mess
by 14113 on Tuesday November 17, 2026 @08:22AM
(#50531007)
> Chip design is harder than that
Chip design is not NVIDIA's advantage, or at least, it wasn't the advantage that "won" it the AI race. NVIDIA's advantage is the quality of the software ecosystem that surrounds the hardware. That is (arguably) a less secure moat.
Re:Nvidia Was in Trouble Before the Jensen Huang Mess
by rsynnott on Tuesday November 17, 2026 @09:21AM
(#50531778)
Funding _suppliers_ to expand their operations is not that unusual; while Apple's maybe unusual in how much it does it, it's hardly the only company doing so (and it's also not new; literally centuries old). Funding purchasers to buy your stuff, outside of certain consumer businesses (notably cars) _is_ very unusual.
Re:Nvidia Was in Trouble Before the Jensen Huang Mess
by tracerbulletx on Monday November 16, 2026 @02:25PM
(#50521822)
Oh no help, I have one of the most in demand products in the world that everyone is paying a huge premium on. I am in trouble, please save me. Total horse shit. If you do a sensitivity analysis to a total collapse of data center demand it needs to be like a 75% reduction before its much of a problem to fundamentals.
Re:Nvidia Was in Trouble Before the Jensen Huang Mess
by w10-1 on Monday November 16, 2026 @03:42PM
(#50522963)
This "trouble" is just silly, and mostly misdirected
(a) making chips is not making datacenters (esp. the memory fabric). Nvidia is working up the value chain (racks, datacenters), backwards (by supporting customers), and sideways (by lowering the cost of related technologies). No one else is close.
(b) Nvidia profit margins are so huge they can destroy competition
(c) The main cited competition is from their main customers, who are just trying to get a better deal from them.
However, the China trouble is real: Huawei is making chips for model-building and inference that the Chinese labs are happily using (to copy models?) that are good enough to dump models and chips to make a monopoly. Stirring up anti-tech, anti-datacenter concerns at the start of this race makes that a real concern, hardly mentioned in the article. It is not possible to face down a cheaper substitute with infinite resources.
Not good that people are stirring false worries when there are real concerns.
Re:Nvidia Was in Trouble Before the Jensen Huang Mess
by ksec on Monday November 16, 2026 @03:55PM
(#50523128)
Media are basically a reporting machine trying to get views. I have known that for quite some time, but this is another experience I will remember.
On the article, most of the tech discussions make zero sense as many of the comments already pointed out. Some of those challenges is also one of the reason why Nvidia has accelerated the whole roadmap and doing iteration of GPU every 18 months of so to stay competitive. Capitalising on leading edge node early and securing larger wafer quantities than even Apple. Large commitments so TSMC is also building Fabs faster than ever. The whole thing filtered out to all the downstream supply chain. Financing it as well making sure the capital is well positioned rather than forcing their partner to raise capital on additional capacity. Same playbook as old Apple. And in case anyone is wondering, it is Nvidia that is now pushing and funding the development of leading edge node along with all the other leading edge tech. Without them, TSMC A14 wouldn't happen as early. PCIe 6.0 would be a year later, Optical interconnect is 2 years early if not more.
It is that Datacenter are put on halt that is the biggest concern. And that didn't happen before "Jensen's mess".
Re:Nvidia Was in Trouble Before the Jensen Huang Mess
by aprilthird2021 on Monday November 16, 2026 @05:45PM
(#50524560)
I don't understand. What is your gripe with the reporting? A lot of people denigrate reporting and reporters and news but it is still relevant and influential. Ultimately, a man who proclaimed loudly that all knowledge work would be replaced very soon, was himself ousted by a reporter
Re:Nvidia Was in Trouble Before the Jensen Huang Mess
by dogscatstrees on Monday November 16, 2026 @05:32PM
(#50524401)
I no longer have trust in these provocative stories. First it was a spy, then not really a spy. Then it was no chips allowed, then it was well-allowed-really-ask-Lutnick, then it was CIA leaking, then actually Rubio-of-State-Dept leaking because of hawks versus capitalists.
Why don't we have these drip drip stories about Tesla in trouble before Musk impregnated a direct subordinate?
Re:Nvidia Was in Trouble Before the Jensen Huang Mess
by dogscatstrees on Monday November 16, 2026 @05:33PM
(#50524414)
I no longer have trust in these provocative stories. First it was a spy, then not really a spy. Then it was no chips allowed, then it was well-allowed-really-ask-Lutnick, then it was CIA leaking, then actually Rubio-of-State-Dept leaking because of hawks versus capitalists.
Why didn't we get these drip drip stories about Tesla in trouble after Musk impregnated a direct subordinate?
Re:Nvidia Was in Trouble Before the Jensen Huang Mess
by lizknope on Monday November 16, 2026 @05:45PM
(#50524562)
> “Everything sold today was designed two-to-three years ago,” says the CEO of a large AI company, who spoke to WIRED on condition of anonymity to avoid hurting business relationships.
This part is true for every big chip company. I've been designing large complex chips for 30 years. This is how long it takes from architecture, design, manufacturing, testing, mass production. Even just fab production is 4 months at TSMC from GDS delivery to finished chip.
> Kress, or whoever replaces her permanently, will have to chart the course that the chip industry will take two years from now, the CEO says.
That's true of every company in this industry. If you want a product to sell 2 years from now you had to decide on what it is last year.
Re:Nvidia Was in Trouble Before the Jensen Huang Mess
by 0erofootprint on Monday November 16, 2026 @06:24PM
(#50525043)
This article was written by someone who never spent any time in the silicon industry. AMD was never far behind Nvidia. Their IP originates from ATI who has been in a race with nvidia since the first day nvidia was concieved. Huawei is not far behind AMD and nvidia, everyone tacking vLLM and other major AI repos knows this. And the TPU work was concieved by people who created attention transformer architecture. Every one in the silicon industry is waiting to eat your lunch, designing more or less the same stuff as you, and hiring all your engineers. -Someone who spend most of their career in the silicon industry
Re:Nvidia Was in Trouble Before the Jensen Huang Mess
by 0erofootprint on Monday November 16, 2026 @06:25PM
(#50525049)
This article was written by someone who never spent any time in the silicon industry. AMD was never far behind Nvidia. Their IP originates from ATI who has been in a race with nvidia since the first day nvidia was conceived. Huawei is not far behind AMD and nvidia, everyone tacking vLLM and other major AI repos knows this. And the TPU work was conceived by people who created attention transformer architecture. Every one in the silicon industry is waiting to eat your lunch, designing more or less the same stuff as you, and hiring all your engineers. -Someone who spend most of their career in the silicon industry
Re:Nvidia Was in Trouble Before the Jensen Huang Mess
by david-gpu on Monday November 16, 2026 @07:42PM
(#50525829)
I worked on AMD GPUs post-ATI acquisition, and many of my coworkers were former ATI employees. Later in my career I joined NVidia.
With all respect to my former ATI/AMD coworkers: the folks at NVidia are on a different league. It wasn't even close. My years at NVidia were a very humbling experience.
Re:Nvidia Was in Trouble Before the Jensen Huang Mess
by david-gpu on Tuesday November 17, 2026 @08:36AM
(#50531158)
There was no big secret sauce. They were simply smarter in average, as a cohort. At ImgTech, AMD and Qualcomm we had more variation: some people were just as smart as folks at NVidia, many were not.
Everything else, I think, was downstream of that. It was a culture of excellence. Like I said, it was very humbling. I'm glad I had an opportunity to sneak in.
This is double true for a Condé Nast publication.
Well - I think the article kind of conflates the problems here.
First - I don't call it "AI gold rush" but instead "AI mafia rush". After all the RAM prices have exploded. Why do we have to pay more because of these gangster companies? Why are governments not doing anything about it? But this is a separate discussion really.
Second - I feel that the "Jensen Mess" is a strange expression, because ... which mess exactly? Does the article refer to NVIDIA having problems? Or does it refer to Jensen and his unstoppable affection for multiple ladies at the same time? Or is it not because of the female non-spy (though, do we know that) but the female spy (though, do we know that)? How many more ladies are part of the Jensen story here?
To me this reminds me a little bit of the issues with regards to Kevin Spacey. Now - the situation is not the same, because personally I think Kevin is a bit creepier here, so this is not 1:1 comparable. But Kevin also is a great actor, he coined numerous iconic scenes (L. A. confidential, Usual Suspects, or my favourite being his performance in American Beauty); and Jensen also was highly successful with regards to NVIDIA. Or, we can also take Michael Jackson - I do not think anyone doubted his skills with regards to art, music and expression (dance), but many may remember the awkward connection he had with some children. These situations are all quite different, but what exactly does the article mean with "The Jensen Mess"? The sex life seems to always be of more interest than other things. That was also the case with Bill Clinton.
Because they're being supplied with the means to realise the Panopticon.
GCHQ in particular are chomping at the bit to be able to utilise all that lovely mass-data gathering they pulled from their fibre taps into Europe.
https://en.wikipedia.org/wiki/Tempora
// what exactly does the article mean with "The Jensen Mess"?
He facilitated a massive circumvention of a strategic export ban to China and played a key role in their ability to distill IP and Advantage from the US AI Companies.
His major gaffe was allowing the public a view behind the curtain to see Oz as human and fallible - and thus the custodian of $2 Trillion of market worth as unsafe. Vitalik Buterin ain't ever falling for a honeypot by comparison.
This lacks an "allegedly".
For now, even if I also believe that it is very likely that he facilitated a circumvention of the export ban, because that would have been profitable for NVIDIA, no evidence whatsoever has been presented publicly to support this, only pure speculation.
This is the free market; demand is high and supply is limited so price goes up. Don't like it? Start making your own and benefit from the higher prices!
I use Apple and AMD chips for desktop inference. nVidia is still cheaper for anything beyond that.
I really only have it for data locality - some customers simply don’t have approval for me to share data from their customers with random cloud inference providers. I also use Bedrock for that but it’s expensive
Free markets can be abused. Demand, in NVIDIA's case, seems to be not all that Jensen, and the company, had been stating. If the core demand was AI companies that were being funded by NVIDIA itself - then it wasn't organic demand.
If "... at least $200 billion worth of NVIDIA AI GPUs are sitting idle in warehouses after being purchased by cloud giants that lacked either the electrical grid capacity or immediate end-user demand to power them on" [0] is true then the demand wasn't there. There's zero reason to pre-purchase a GPU a year, even 6 months, ahead of build. Sure, maybe Google / Amazon / SpaceX buy during build - but these companies actually build their DCs, they don't buy GPUs and store them in a warehouse for quarters on end unless something went wrong (maybe like in Finland [1]). Jensen may very well be in a lot deeper than anyone really knows. The reporting as of late has stated that commitments by NVIDIA to memory suppliers was coming in and there was likely not enough non-circular capital to cover. The reality is Jensen likely thought he was going to be the AI kingpin, having a piece of all the AI pie and that he'd have enough time to recoup his ponzi-like investments in the downstream by paying for his own products.
I, personally, don't think we've even seen the start of this story. It's probably a huge mess starting with Jensen and flowing down through his kids. I can't imagine everything was on the up and up given the scale of dollars involved. It almost feels like the affair was a scapegoat to get out of the hot seat. Ultimately time will tell.
But, TL;DR - if you think the demand for NVIDIA was completely organic, well then I have a crate of Founder's Edition 5090's to sell you for dirt cheap.
[0] https://wccftech.com/jensen-huang-financed-ai-startups-absor... [1] https://www.reuters.com/business/environment/finland-launche...
People I know with adequate space and power have also heard these rumors and have looked high and low for parties with these billions worth of idle GPUs-- either to purchase their hardware or offer them hosting-- and cannot find them.
I think people are just making this up. If I'm wrong and you know someone in need, let me know and I can connect them with someone with 2GW+ of capacity.
Sure, it sounds simple but again, I don't think we understand any of the complex web of moving parts that are involved here.
So, you will not have money and you are going into a field with big competition where all you have to go on is "well, I surely could do better." Not impossible, but that takes existing establishment in the field. You are not going to see mom and pop chip companies. Not without some major breakthrough that sets them apart.
Disgusting.
* on the uncertainty
There were lots of traders who lost a lot of money betting against the housing bubble pop in 2005. The bubble was front page news on the Economist in 2005. Michael Burry made a lot of money because it took him a couple of years to assemble the money to be able to bet against the market and so he got lucky on the timing.
Or as the aphorism goes: the market can stay irrational longer than you can stay solvent.
That said, Nvidia is in a strong position.
Even in a slowdown, they probably would do ok.
It's peak delusion to think that AI is going away.
AI will not crash, but, a slowdown in AI could very well cause a general recession, precisely because it's he only thing holding the economy up.
That's a totally different thing though.
Even if it's not going away, it'll be a breath of fresh air when it's not shoved into every possible place as a marketing tactic, even when it's not necessary or beneficial. AI does have it's place, I just hope we realize soon how every place is not that place.
It will follow the same pattern that technologies like phones, computers themselves, the internet, and (I guess) cloud storage now touch on nearly everything.
Example: even if you're an old-fashioned boutique leather artisan who makes handmade bespoke horse saddles in 2026 like it was 1783... your business also probably uses all that other stuff in some capacity. You probably have some computers for design and payroll and answering emails, a website that lives somewhere in the cloud, etc.
On a closely related note, if you're tired of hearing "AI, AI, AI" everywhere, there's reason to feel encouraged. Ten years ago, nobody would shut the fuck up about "the cloud." It didn't go away, it just matured and now it's how most people do many things.
They're useful certainly and won't be going away after any financial bubble bursts, whether they are so useful they need to be rammed into every facet of our lives remains to be seen.
One big difference between the internet and LLMS - people enthusiastically adopted the internet and found all sorts of uses for it. LLMs companies are mandating usage by employees and trying to force end users to use it, which seems really strange, why would they have to do that if it's so useful?
Companies are 'mandating' use of AI because they see the potential in it.
In 1997, people were not sophisticated enough to grasp how broad the web would be - if they did - managers would have been pushing everyone to adopt the browser and email.
That said, in the 1990's they were actually pushing everyone to adopt 'Windows' etc..
We have a better grasp of how tech affects the economy, and so now there's a lot of hype. Probably too much.
AI is just in 'Phase 1'. The current Chat Bots are basically like the 'Commodore 64' - a 64K computer.
The hype is annoying - I use AI all day and find it useful and drives me crazy but at the same time 'it's real at the baseline'.
It will not 'explode' I think any time soon, it's going to take years, but in 5 years we will look back and see a huge amount of change.
In 5 years, up to 1/2 of AWS services will be AI based for example. All sorts of new features.
An example: RAG is being embedded into most DBs now, that's a big deal and taht's just 'embedding' not even really AI. In a few years, regular 'javascript jockeys' will be used to that kind of thing.
I'm by no means AI-pilled, and I'm skeptical of all these shenanigans ... but 'it's real'. This is happening on about the scale of the Web Browser.
AI has already had a massive impact (machine learning to recognise pictures, spot patterns in data etc) and will continue to do so.
We're talking about LLMs here and the huge amount of money that has been pumped into them by companies like Nvidia in circular deals with their customers. Personally I think the jury is still out on whether LLMs will develop much further than they have. Comparing Opus 5.5 to Fable 5.2 this week I've seen little difference. We'll see in time though.
AI is going to make it's way into everything, it's inevitable.
I lived through internet, .com, mobile, SaaS - I'm telling you from being 'inside' all of those, that LLMs alone are enough to be that impactful.
The are where it will be most visceral is robotics.
Once the robots start cleaning your bathroom, it will seem clear how it's bigger than browsers.
Just because LLMs are useful doesn't mean it will have a trillion dollar evaluation.
An economy built on a lie sooner or later crashes into the reality. The sooner the less damage it will cause.
I don't think demand for Frontier AI will go away either - even as in the near future 90% of AI will be 'commodity AI' - the Frontier foundries will still have competitive differentiation to offer.
Just like SaaS - technically almost all SaaS should be 'commodity' ... and yet it's not.
I think we can all agree that we are 'sick of the hype' but that doesn't mean the engine will diminish.
All the stuff about Jensen's affairs, NVidia sales to China, circular financing, increasing competition in the market, etc. was known months ago. Indeed, much of it came out in research notes by major short-selling funds. And NVDA is an extremely attractive target for shorts, having been bid up high by the AI bubble and then having a lot of retail interest that could easily be pushed the other way. Entirely possible that certain funds have taken a large short interest and are now trying to give it that push to profit.
1) short sellers do not control the press. The best they can do is material leaks, like those 'Heisenberg' or whtever research companies, but you have to drop a real bomb for that
2) Trump is generally pro Jensen and most of the Cabinet and tech people are, and Dems don't have a specific fight with him
3) Jenses is not a likely face of 'tech evil' like Musk could be.
Most likely what you are witnessing is how ugly and nasty the press can be.
I've seen so, so many articles fro 'resepectable news outlets' with tawdry and slacious headlines - and almost no real information.
The 'timeline' of Mega Speed ? Had to go to AI to find it, and it's far more nuanced than what the headlines are saying.
The press loves waves and hype - it brings them revenue.
I think there is pent up anti-AI populism and the Jensen story was just the thing to pop first.
So he got it.
Also - the news just kept leaking aka 'yet another woman he slept with' so that kept the story alive.
There also might be things we don't know aka stuff that the Board has been made aware of that we don't know.
I think it's sad because I think Jensen is a reasonable and decent person that owes an apology to his wife, and not really anyone else.
And Huang was by far the most powerful person outside of china taking the other side of that. I'm not going full conspiracy here, I genuinely don't think it was necessarily a coordinated takedown or anything like that. But if you look at whose public positions incentivize them to rile people up around this it is definitely worrying.
If you read amodei's remarks over the last few years he very clearly considers llm development to be a US vs china cold war 2 type deal that justifies dramatic action that would otherwise be morally abhorrent.
Now here's the conspiracy brain part. Say you're ideologically committed to inhibiting chinese labs' ability to develop open models, and willing to do anything short of literal bloodshed for it. We know tech companies consider manipulating public sentiment for their own purposes to be within the bounds of fair play. And in this hypothetical you have unlimited unrestricted access to claude mythos. What could you do with it?
Unless it's some 4d chess tactic, the timeline doesn't have much sense, the ANT IPO is paying for this takedown.
And generally speaking, if you want to control you adversary you try to "leak" tech and information in order to control how much and what exactly he knows. Going full ban doesn't make any sense in the long term.
[1] https://finance.biggo.com/news/a10a2d57-9a11-43da-8600-4c5cf...
It's forward P/E has been well below market average for a while now.
Also for Nvidia, when a stock reaches number one and gets up to a few trillion market cap, there is hesitancy, same happened to Apple at times.
The Nvidia ecosystem… not so much. Most all of these pieces fail to recognise their already dominant position in the edge inference space - and most all of these pieces fall into the trap of AI=LLMs=ChatBots, and really, who wants to chat with a computer any more.
I don’t mind. This has been a great week to stock up on the equity, and there was enough blood in the water before the salacious spy sex story that I bought a bunch of very, very cheap $150 puts, as hysterical overreaction is the plat du jour, which I sold on Thursday.
https://www.reddit.com/r/NvidiaStock/comments/1xvefbv/before...
I'm generally not an Apple customer at all (I own an old Mac Mini to do occasional iOS development, but rarely use it), but think they are a better bet long term than any of the AI labs.
There's so much projection and wishful thinking about completely normal price movements in hyped stock.
> You don't have to assume … that the AI bubble is popping
I’m not saying it is, but what is a bubble popping, if not a bunch of people saying “oh this might be the highest we go for now, I’m gonna take my profits”, which causes downward pressure for those who come slightly later who also want to take profits, etc?
The question is just if enough people stop to take profits to trigger that chain reaction. After all, it’s basically the same as saying that the seller thinks the current value in cash is more valuable than the future value of the company, otherwise people don’t really sell
You just described a bubble...
Not saying this author does. But senior leadership at Wired?
Everyone just using an obfuscated form of Elon's "GAMESTONK" strategy to boost their position.
Journalists plausibly have the same goal: speak truth to power to protect society. To be an investigative reporter you take on immense amounts of personal risk, and on very rare occasions get a big payoff in terms of recognition and career prestige.
So Wired is "short" Nvidia only in the sense that they benefit from pointing out its problems, and mostly only if they are right and get the timing right, otherwise they just lose status.
It's a legal shield to insulate the real people from having their personal lives destroyed in court; they were just following orders type thing.
I never said shorting was easy; don't put words in others mouths.
Doesn't stop people from trying. This forum is naive af about a the world; there are billions of people who don't know you exist making choices that, like a spider-web, shake the various social webs of people and impact you.
They won't be fitting into your absurd reductionist take on human behavior.
Internet: The end is near! The market is collapsing.
Investors: Well I was up 100% but now I'm up 80%.
That's bad math. If you had 100k invested, and you're up 100%, then you were at 200k. A 20% drop leaves you with 160k, and you're only up 60%.
But oh no, whatever shall I do. Oh, I’ll hold. That’s what I’ll do.
The press is hot trash. The financial press doubly so.
If you own shares in a company like that, you need to evaluate how that can be changed - either your ownership of the shares, or the corporate governance of the company.
The board is the one who ousted him! I agree that they should have been better prepared, but from the outside this looks like a long-running power struggle. Jensen didn't accidentally wind up with 60 reports. The board finally found an opportunity to correct the issue.
If they had forced him to do either of those things, it might have suggested that he was... replaceable.
What we have here are a bunch of boards that can't do anything, won't do anything, or both. SV founder culture is a bunch of people who believe themselves to be the special boy and being completely unwilling to deal with anyone who might tell them otherwise.
Corporate governance needs real reform.
But as this situation evolves, the spying allegations were BS which is why nothing moved on it for a year, and it looks like they need him back to manage Asia in exchange for tweaking the org chart and coming up with a succession plan. That org chart that led to his shenanigans is the same one that let him adapt faster than any of his peers. Good luck figuring out the best path forward here.
That's the lesson lots of aspiring founders with untreated personality disorders will take from it, yes. The ones who don't are the ones who realize they're human, prone to mistakes, and will want to protect the legacy they've built with a system that constrains them.
Also, can't wait for the downvotes on this one. Every time I suggest that boards should have actual control over the c-suite, particularly founder CEOs, I get downvoted.
Whenever I post something on here suggesting that perhaps we shouldn't give single individuals complete control over corporations worth trillions of dollars, regardless of whether or not they founded the company, I see downvotes. It makes sense; HN is the discussion forum for YC and my thoughts directly conflict with a sizable portion of the user base here, many of whom want to be the next Steve Jobs, just without the years in the wilderness.
I don’t think the report and rankings should be taken as gospel but it’s an interesting read to consider given the clear failures of the board.
https://jdrurypartners.com/news/weight-of-americas-boards-20...
Some suck. Google's Tensor is an example of one that doesn't, that some consider superior to Nvidia's offering. There are likely others.
Some, but how much? Once you have a mass produced ASIC with a model that's "good enough" much (but obviously not all) of the demand for the cutting edge could evaporate quite rapidly I think.
I'm unsure about the energy efficiency of Tenstorrent cards, but they are at the moment much more cost effective than Nvidia. But software support is far behind, I suspect if it wasn't the cost would be more equal.
No. Per Jeff dean.
Within Google itself the TPUs are definitely preferred for AI workloads, you just can't always get them.
I mean, Google tell me it's TSMC's 3 and 2 mm process - exactly what you'd expect. But you can Google as well as I can.
You can see the process node table here.
The newer chips are probably 3nm and they are probably developing the next chip in 2nm.
The writing was on the wall for TSMC ever since the 5nm node; Apple proved that anyone with enough liquid cash could block competitors from fab access.
TPUs are significantly less flexible and I would guess at an individual level not as efficient or fast as Nvidia. But they're designed specifically to be bundled together in large arrays with similarly large data pipes to storage and interconnects to cache, ram and other compute. I would guess Google didn't bother trying to sell them until recently because you needed to be deploying them at large scale for it to be even worth also developing the software for.
What we really need is innovation in super fast (bandwidth and latency) and reliable interconnects. I suspect the days of slotted in GPU and RAM will be over soon and we'll see a move everywhere to pin based sockets (like we've always had for CPUs). Stuff like SXM and LPCAMM
They're not buying up "all the supply to build an inferior product". They're buying it up build a different, high-demand product.
Google's used this strategy a few times before, and it frequently doesn't work out. They kept MapReduce and GFS proprietary so they could build better big-data services than everyone else, but Doug Cutting from Yahoo clean-roomed it, and then eventually you had interviewees going "MapReduce? That's like Hadoop, right?" They had a long string of internal ML frameworks well before the rest of the industry (I remember in the '00s and early '10s Google was by far the leader in large-scale machine-learning) but had to open-source TensorFlow in the face of external competition, and then lost in the marketplace to PyTorch because TensorFlow was filled with internal WTFs and footguns needed to support specific Google projects. They had a big lead in datacenter technology over everyone else in the industry in the early 2010s, but kept it internal and proprietary until they were forced to sell it as a service by the huge growth of AWS and Azure, then had to play catch-up as a distant 3rd because they lacked the customer relationships and developer mindshare.
Both are fabless customers of TSMC, which happens to be the choke point.
Unlike gp, I do not believe its a market failures as much as the cutting-edge process node bieng a natural monopoly. Once TSMC processes got really good, TSMC started capturing most of revenue dollars and reinvesting them, which made TSMC products even better - a situation that makes it impossible for Samsung or Texas Instruments to catch up. Intel rode on a similar wave for decades
https://www.insidedeeptech.com/tsmc-cowos-packaging-full-gui...
I think even if you have the capital to acquire something from ASML… by the time it’s setup and tuned correctly TSMC will likely have enough capacity to eat your lunch. If it takes 2-3 years to get a fab online TSMC will likely have a new node and their old ones will be available.
TSMC has really proven over the past 5-10 years that the fab is its own beast and requires its own immense level of expertise and investment. When you have the worlds largest chip companies shoveling all their manufacturing dollars through one single org, that seemingly does the right thing, it’s going to be pretty much impossible to beat them.
Literally TI even uses TSMC for the digital only stuff they do. The investment for these cutting edge nodes (or even, not so cutting edge. Like say, 10nm) is absurd vs the payoff.
The main thing is that chip manufacturing is the most highly capitalized industry in the world. Each manufacturing step has gargantuan costs and so no company wants to manage (and pay for) all the steps - so TSMC buys chip manufacturing equipment from ASML and sets up a system where corporations buy capacity. It's essentially a very, very, very expensive print shop. The print shop doesn't make its own printers nor it print a newspaper.
And naturally, with very, very objects like leading-edge chips, "inferior" or "superior" is a ridiculous simplification. Nvidia chips are incredibly powerful and useful. Nvidia has been more committed than any other company to general purpose GPU programming.
But Nvidia also is doing it's best to sell at high, monopoly prices. That's why they buy a lot of capacity. The thing about the situation is these companies did spend a lot of money reaching this monopoly situation so from their viewpoint, this monopoly pricing might be fair. But I personally wouldn't care and hope some regulation stops it. But that kind of regulation would still have to get these companies significant profit on these investments, so they'd keep making them.
If I come to a coffee supplier and say I can pay 50$ for a sack of coffee but I don't know how many I can buy yet as I am building up my coffee shops around the country and then Starbucks comes in and says we are willing to pay 55$ and pay ALL your capacity guaranteed, today, just sign here.
Where do you think most coffee sellers would sign?
You've got it all mixed up.
Google designs the TPU in partnership with Broadcom. Many companies will write the Verilog RTL and then send this to another company like Broadcom to do the physical design and turn the Verilog along with lots of other IP blocks like serdes into GDS mask data.
Broadcom does not have any fabs. They send that GDS mask data to TSMC to manufacture the chip just like Nvidia, Apple, and tons of other companies.
I'm a physical design engineer if you have any questions.
Inference has already been commoditised.
https://d1.awsstatic.com/onedam/marketing-channels/website/a...
But the next gen of Tenstorrent HW looks great on paper - problem is, I could have written that before the current gen was released.
All of the allegedly competing HW looks like that and has looked like that for years, either a lack of availability, capability, or both.
Already these are run on different hardware, at least as I understand, and the computational needs could further drive differentiation.
https://www.forbes.com/sites/jonmarkman/2026/08/09/amd-buys-...
It is available to Oracle.
https://www.oracle.com/news/announcement/ai-world-oracle-bri...
Why? Don't they want to add another $3-5T of market cap?
Do we actually know they're more efficient per watt or for the power used and heat produced ? Or are they just easier to scale (and manufacturer) en masse ?
There's also the CUDA moat which is hard to get around
Nvidia's moat for LLMs isn't Cuda, it's installed capacity, arrangements with frontier labs, TSMC bandwith, and just the fact that it currently has no real competition.
This Huang scandal has so many dimensions that are clearly more impactful on the world outside than to NVIDIA itself -- the blast radius seems to extend to the US cabinet -- that it begs questions if Jensen Huang wasn't id'd as the essential piece to remove to affect a comprehensive restructing in the segment.
So if deals fall apart because Jensen and his handshake have left the room, that may unclog many memory and processing supply lines that are currently spoken for by deals with Jensen. That may have been a goal from the start.
But once you do that, translating CUDA into one of many available vectorized backends is trivial.
We have a bunch of custom kernels for geometric operations (like merging polygons) and they were rather difficult to write a while ago. AI rewrote them in HIP during my lunch break.
those Asics have a fixed algorithm
Cerebras already does that an need to make a new chip for each new model
that's why you couldn't make an ASIC for Ethereum
I'm kinda bewildered, it's bizarre seeing people cheer on quickly-obsolete accelerators instead of demanding their OEM to adopt GPGPU. CUDA will be relevant for much longer than any ASIC can ever be, even (or especially) if the transformer gets replaced overnight with a better architecture.
Ethereum's work function was designed to be memory bandwidth limited, which is something gous are already quite well optimised for. An asic would be faster but not by enough to be worth the investment, at least while gpu margins were less crazy.
The main thing is the actual number crunching and memory interfaces for LLMs are not crazy hard to implement, and the potential scale is huge, so NVIDIA's moat is not likely to be big enough to make their current margins sustainable in the longer run.
My background is ASIC design and more recently 3rd-party IP development for integration into ASICs. In our last design I made heavy use of resource sharing (RAM and holding regs for intermediary values, counters, LUTs, complex multipliers, adders, etc, even state machines).
That got the wheels turning. I believe such an approach can be generalized to support a wide range of computation and thus algorithm development. Even state machines can be configurable if designed that way. All controllable by programmable registers.
Just don't look for AI to take on such a task. Or go ahead and try, it already fails miserably when it comes to RTL design (verilog, vhdl). LOL
one in the "Cerebras" direction of ever-larger scale general purpose HPC silicon running inference workloads. Cerebras may have skipped ahead to the last act of that scaling story, notwithstanding any further wafer-diameter enlargements past 300mm. Whether the ending is happy or not is still unclear. Lot of iterative room to grow into it further and they have a formidable patent moat waiting for conventional die-sized AI semi vendors when they inevitably run up against limitations of single-die designs.
the other is in the "Taalas" direction of freezing a specific model into something like high speed ROM / FPGA and getting orders of magnitude inference speed improvements - for that specific model. Like Cerebras, Taalas may also have jumped directly to the architectural telos of that philosophy, with only iterative improvements in cost per work unit left to grind, though like CBRS quite a lot of grinding left to do especially in getting cost per custom tapeout down to near-disposable (hopefully, recyclable) levels.
Yeah I was thinking this will probably be the case. We may eventually settle into a slower release schedule as well, where a new model only comes every year or two.
Bitcoin was lucky for Nvida, the AI was lucky. Third times the charm?
On other hand, luck favors the prepared. Beyond luck, they did make their chips accessible, easier to program than other GPU's. So bitcoin miners and then AI could utilize them.
There are still a lot of people that want to run regular liner algebra.
Nvidia cards were the worst hashrate/purchase price of any cards. AMD were the lucky ones there if you consider anyone lucky in this situation. Consumers definitely weren't lucky because the GPU market hasn't recovered since the Etherium boom.
I imagine the 1070/1070ti 1080/1080ti were decent at mining, but a lot more expensive to obtain for these gpu mining rigs with 6-10 gpus in them.
I wonder if cooling such a beast, with very non-uniform hot spot distribution, would be too complicated to bother with though.
That function block was worth the cost of accusation.
But Bitcoin mining moved GPUs to ASICs many many many years ago and Ethereum switched from proof-on-work using GPUs to proof-of-stake: GPUs are pointless now for Ethereum. And Ethereum was the big one for GPU mining. All the others cryptocurrencies are too tiny to register.
Ethereum switching from proof-of-work to proof-of-stake has been the death blow to GPU mining at scale. I'm not saying some have not been profitable mining other less important coins: I'm saying the market for GPU mining shrank to next to nothing.
Training? I'm not so sure. You need something flexible so that it can be trained. Burning the weights into the board is the opposite of that.
At these dimensions, you are better off producing general-purpose inference ICs that can run any model, instead of baking in a single fixed LLM.
The thing is, it's only NVIDIA really that has a proven product in high volumes pumping through TSMC with the existing software stack that the community has already proven. That's a huge difference. Everything else is riskier if you're building out in volume. For now.
Relevent article from september 26. To me it’s obvious gpu are a « first response » solution. But I think nvidia can sell a lot before AI R&D slow down (because of the demand or the tech, infra, energy… or whatever reason it will be)
They still buy Nvidia and x86 chips but this is what the WSJ article from last week was saying. The hyperscalers are moving away and Nvidia is committed to TSMC wafer orders.
Microsoft
https://blogs.microsoft.com/blog/2026/01/26/maia-200-the-ai-...
https://techcommunity.microsoft.com/blog/azureinfrastructure...
Google
https://cloud.google.com/tpu
https://cloud.google.com/products/axion
Amazon
https://en.wikipedia.org/wiki/AWS_Graviton
https://aws.amazon.com/ai/machine-learning/inferentia/
https://aws.amazon.com/ai/machine-learning/trainium/
I guess they mean Groq. Anyone know what nvidia did with groq btw?
Specifically: https://www.nvidia.com/en-us/data-center/lpx/
We ran a pure-LPU demo for HotChips that AA benchmarked: https://developer.nvidia.com/blog/how-nvidia-groq-3-lpx-unlo...
TLDR: LPUs are very efficient, quite a lot more efficient and faster tok/s/u than anything else at this years Hot Chips.
It's my personal opinion that with the way models change you don't want silicon that is too specialised but it needs to be specialised enough. LPUs are designed to strike this balance such that they remain flexible if model architectures change drastically.
I don't know if HBF in particular is going to be huge but it's just so hard to predict the future in this space.
My personal opinion is we should be paying attention to SerDes and base dies to keep compute flexible and able to adapt to whatever memory and storage solutions are not supply constrained.
With things like https://developer.nvidia.com/blog/co-designing-ai-models-usi... you can specialize one chip for decode/drafting, and the other for prefill and draft verification.
Could see a board with something like two SXM slots (maybe or similar) and one being for LPX optionally be cool
One of Tim Apple's [sic] big innovations was to take Apple's giant pile of cash and use it for vendor financing. Building a new fab or process or factory is expensive. Borrowing money is expensive and risk. But Apple gave favorable terms in exchange for a period of exclusivity to whatever the vendor produced. This was huge for the iPhone for years.
NVidia is kind of in that position now. One can say that there is circular financing between NVidia and the big AI companies but is it really that different to Apple's approach? I'm not entirely convinced that there's an imminent domino effect collapse coming as a result of all of this. And, even if it does, I don't see it taking down NVidia.
Boeing (and Airbus) is the other company NVidia reminds me of. The business of selling planes is complicated. Boeing gets to throw its weight around and demand concessions. Launch partners for new planes get favorable delivery dates but that's also a chain. Qatar Airways famously went to war with Boeing and lost its A321 orders. That's the kind of power NVidia has now over the AI providers. It gets to decide who gets to buy and when.
As for competitors, there are always wannabees. Remember the decade of Google killers? I do. What happened to them all?
It surprises me on HN of all places how many people think you can vibecode a GPU competitor to NVidia, basically. I'm sorry but no. Chip design is harder than that. Managing relationships with suppliers, vendors, the fabs (particularly TSMC), etc is hard. NVidia has been doing it a long time, has a lot of built up expertise and has a lot of volume and weight it can throw around.
Jensen Huang was correct about China (IMHO). Restricting the chipmaking from ASML is one thing. Restricting the chips was a mistake in foreign policy terms. It has created captive domestic demand for Chinese chips. And it's too late to unring the bell. Xi Jinping realizes that chipmaking and AI is of national security interest to China. Yes there'll be some smuggling in the meantime but I fully expect China's EUV to be producing commercial chips by 2030. China simply doesn't want to be beholden to Western companies in the exact same way that most US tech companies were banned in China. I believe history will vindicate Xi's long-term strategic thinking in this area (yes, blocking the likes of Facebook and Uber predated Xi, I know).
I also think AI isn't going to be ASICed anytime soon like crypto mining was. Crypto had a fixed algorithm. AI does not, at least not yet. It's constantly changing. Even in recent years we've tried different quantization methods (eg fp4, int4). Model architecture is still evolving at a rapid rate. It's way too early to fix that into hardware.
Chip design is not NVIDIA's advantage, or at least, it wasn't the advantage that "won" it the AI race. NVIDIA's advantage is the quality of the software ecosystem that surrounds the hardware. That is (arguably) a less secure moat.
(a) making chips is not making datacenters (esp. the memory fabric). Nvidia is working up the value chain (racks, datacenters), backwards (by supporting customers), and sideways (by lowering the cost of related technologies). No one else is close.
(b) Nvidia profit margins are so huge they can destroy competition
(c) The main cited competition is from their main customers, who are just trying to get a better deal from them.
However, the China trouble is real: Huawei is making chips for model-building and inference that the Chinese labs are happily using (to copy models?) that are good enough to dump models and chips to make a monopoly. Stirring up anti-tech, anti-datacenter concerns at the start of this race makes that a real concern, hardly mentioned in the article. It is not possible to face down a cheaper substitute with infinite resources.
Not good that people are stirring false worries when there are real concerns.
On the article, most of the tech discussions make zero sense as many of the comments already pointed out. Some of those challenges is also one of the reason why Nvidia has accelerated the whole roadmap and doing iteration of GPU every 18 months of so to stay competitive. Capitalising on leading edge node early and securing larger wafer quantities than even Apple. Large commitments so TSMC is also building Fabs faster than ever. The whole thing filtered out to all the downstream supply chain. Financing it as well making sure the capital is well positioned rather than forcing their partner to raise capital on additional capacity. Same playbook as old Apple. And in case anyone is wondering, it is Nvidia that is now pushing and funding the development of leading edge node along with all the other leading edge tech. Without them, TSMC A14 wouldn't happen as early. PCIe 6.0 would be a year later, Optical interconnect is 2 years early if not more.
It is that Datacenter are put on halt that is the biggest concern. And that didn't happen before "Jensen's mess".
Outsted by reporter spreading lies and unconfirmed information as confirmed news.
Why don't we have these drip drip stories about Tesla in trouble before Musk impregnated a direct subordinate?
Why didn't we get these drip drip stories about Tesla in trouble after Musk impregnated a direct subordinate?
This part is true for every big chip company. I've been designing large complex chips for 30 years. This is how long it takes from architecture, design, manufacturing, testing, mass production. Even just fab production is 4 months at TSMC from GDS delivery to finished chip.
> Kress, or whoever replaces her permanently, will have to chart the course that the chip industry will take two years from now, the CEO says.
That's true of every company in this industry. If you want a product to sell 2 years from now you had to decide on what it is last year.
A fab is a highly, highly error prone environment. A company can't just build a fab, hire nerds, and have a competitive business.
Even with the top equipment in the world it takes scores of brilliant people to even make a decade old process.
Semiconductor manufacturing is an art, science, and magic.
With all respect to my former ATI/AMD coworkers: the folks at NVidia are on a different league. It wasn't even close. My years at NVidia were a very humbling experience.
Everything else, I think, was downstream of that. It was a culture of excellence. Like I said, it was very humbling. I'm glad I had an opportunity to sneak in.
Wow, who would have thought 3 weeks ago?
No CAPTCHA, no geo-blocking, no Javascript, no cookies, no user-agent header required
Text-only: Two headers only, no user-agent header: