Re:Nvidia H100 GPU Shipments by Customer
by marcus0x62 on Saturday December 02, 2023 @08:31PM
(#38503965)
Also consider that the $3,320 figure appears to be an estimate of the cost to manufacture an H100, which doesn’t encompass all of Nvidia’s COGS (R&D, warranty reserve, etc.)
Re:Nvidia H100 GPU Shipments by Customer
by freedomben on Saturday December 02, 2023 @08:56PM
(#38504091)
agreed there probably is a bulk discount of some sort, but Nvidia has them by the balls because there aren't really other options, so they pressure to give good bulk discounts would be lessened a bit
Re:Nvidia H100 GPU Shipments by Customer
by samspenc on Saturday December 02, 2023 @09:12PM
(#38504162)
This makes sense, let's say that R&D per unit is a similar amount, that would totally explain how Nvidia is able to generate insane 50%+ net profit margins (74% gross margin), higher than FAANG and unheard of for hardware companies [1][2]
Re:Nvidia H100 GPU Shipments by Customer
by fulafel on Sunday December 03, 2023 @02:41AM
(#38505543)
It's seems fourth (at best) hand info, the source being a tweet by an analyst referencing another analyst.
NV does not manufacture chips, wonder if charitably they meant that they pay this much to the manufacturer? In that case this would be their price, I guess in a way "manufacturing cost" but quite misleading since the chip manufacturer probably has big margins.
Re:Nvidia H100 GPU Shipments by Customer
by sebmellen on Saturday December 02, 2023 @06:22PM
(#38503242)
Incredible that Meta has 1.5x the amount as Google and Amazon combined. For all the criticisms of Zuckerberg, Meta is an insanely strong and well-aligned organization, and their open-source contributions are unparalleled.
Re:Nvidia H100 GPU Shipments by Customer
by MichaelRazum on Sunday December 03, 2023 @10:02AM
(#38507525)
Maybe, if you already reached the atmosphere with it. Obviously, current AI tech scales with compute. It "may" be the case, that just more compute is enough to reach the moon..
Re:Nvidia H100 GPU Shipments by Customer
by gymbeaux on Sunday December 03, 2023 @06:05PM
(#38511712)
It’ll be interesting to see how long these GPUs are in use, AND what the secondary market will look like in 5 years. Will NVidia shaft Microsoft and Meta like they shaft consumers re: driver support and other artificial limitations/planned obsolescence.
Theoretically Microsoft for example just needs to train one or two models and then retrain every so often, so I’m skeptical that NVidia will continue to knock it out of the park from a sales perspective. I wouldn’t be caught dead holding NVDA stock right now.
Re:Nvidia H100 GPU Shipments by Customer
by 1letterunixname on Sunday December 03, 2023 @11:39PM
(#38513800)
Meta committed to spend $20 B per year on servers for 2023 and 2024. A large fraction of that is going to Nvidia for AI-powered, OCP-derived custom boxes that accept H100's.
The hilarious part is Zuck can't articulate a strategy for this spending at all.
I'm sure a customer ordering 150.000 will get a discount, but how much? (150.000 x 25.000 = 3.75 billion)
NV does not manufacture chips, wonder if charitably they meant that they pay this much to the manufacturer? In that case this would be their price, I guess in a way "manufacturing cost" but quite misleading since the chip manufacturer probably has big margins.
Buying H100's is almost necessary if only to assure you're not compute starved.
FOSS is all well-and-good, but that doesn't directly translate into profits.
Except it's based on a vague, "build it and they will spend" wing and a prayer cargo cult rather than fulfilling any specific, pressing need.
Morale is low as there are round after round of layoffs.
So maybe that's why they don't have so much in the way of stuff from NVIDIA?
Also: how come Chinese companies are on this list!? I thought H100 exports to China were banned by the Biden administration!
Theoretically Microsoft for example just needs to train one or two models and then retrain every so often, so I’m skeptical that NVidia will continue to knock it out of the park from a sales perspective. I wouldn’t be caught dead holding NVDA stock right now.
The hilarious part is Zuck can't articulate a strategy for this spending at all.