News for hackers. Stuff that matters.
Re:Next-Concept Modeling: Fast, Parallel Coarse-to-Fine Text... by OOTY00TYOO on Monday November 09, 2026 @07:02AM (#50424432)
If we cant' build the hardware fast enough. Can someone explain to me why there's apparently 50% of the gpu and memory that hyperscalers buy sitting in warehouses due to lack of data centers? The hyperscalers are hoarding tech and can't even use it. It's ridiculous.
Re:Next-Concept Modeling: Fast, Parallel Coarse-to-Fine Text... by IanCal on Monday November 09, 2026 @07:15AM (#50424560)
That depends on how long it’s sitting there, given they are two different things to manage it makes sense that you’d either have gpus sitting unused while a dc gets built or a dc sitting empty while you wait for gpus.
Re:Next-Concept Modeling: Fast, Parallel Coarse-to-Fine Text... by idiotsecant on Monday November 09, 2026 @07:23AM (#50424631)
Because slowing down compute purchase is collapsing the hype train which is the same as death. Vibes are a wave that must be maintained or crash down onto reality.
Re:Next-Concept Modeling: Fast, Parallel Coarse-to-Fine Text... by dormento on Monday November 09, 2026 @08:10AM (#50425112)
Also, tinfoil alert, if they buy it means you can't (or are eventually priced out of the hw market). Their only "moat" (if you can call it that..) is the price of local inference capacity, which is still kinda prohibitive for the 99%.
Re:Next-Concept Modeling: Fast, Parallel Coarse-to-Fine Text... by alansaber on Monday November 09, 2026 @07:37AM (#50424762)
They could probably rush them to production, but it's added logistics and would lead to the parts degrading faster.
Re:Next-Concept Modeling: Fast, Parallel Coarse-to-Fine Text... by dsjoerg on Monday November 09, 2026 @07:49AM (#50424873)
I dont understand how this comment connects to the linked research paper. Anyone?
Re:Next-Concept Modeling: Fast, Parallel Coarse-to-Fine Text... by tomrod on Monday November 09, 2026 @01:13PM (#50429248)
There as a Youtube overview that tried to tie the research paper and the consequences on the market that I saw on this topic.

I suspect other influencers/popularizers are parrotting the same claims. Its not directly related IMHO.

Re:Next-Concept Modeling: Fast, Parallel Coarse-to-Fine Text... by rhdunn on Monday November 09, 2026 @07:50AM (#50424894)
There are reports and rumours that NVIDIA are forcing the data centre companies to buy the GPUs upfront. Though there isn't a lot of clear evidence that this is the case.

[1] https://tech.yahoo.com/gaming/articles/did-nvidia-manufactur...

[2] https://www.reddit.com/r/Games/comments/1xdjbd1/multiple_rep...

[3] https://www.techradar.com/computing/gpu/is-the-gpu-stock-cri...

[4] https://www.businessinsider.com/amazon-nvidia-ai-gpu-data-ce...

Re:Next-Concept Modeling: Fast, Parallel Coarse-to-Fine Text... by Lerc on Monday November 09, 2026 @09:14AM (#50425929)
As far as I can tell, because that is not happening.

The suggestion seems to have come from the claim that to maintain a priority queue, you have to be buying consistently. That might mean buying more than you need to ensure supply when you need it. The assumption that the excess goes into a warehouse seems to have come from someone's fevered imagination.

If there are GPUs built and not yet installed, and people who want to be using them now, money can be made getting the supply to find the demand. Most large scale companies know how to do that sort of thing. If someone has a data center and no GPUs arriving for six months, paying a few million to trade the GPUs that will exist in six months for the ones that exist now gets them an additional six months of operation, while ensuring the original buyer will have GPUs when they need them, plus a few million.

Re:Next-Concept Modeling: Fast, Parallel Coarse-to-Fine Text... by torginus on Monday November 09, 2026 @10:11AM (#50426731)
Yeah. Don't know anything about data center GPUs, but it's common knowledge you can get like 80% of the performance of a gaming GPU at half the power or even less. That's basically how Nvidia's mobile GPUs are. So if you had a warehouse full of GPUs, you could just go ahead and install them, run them at low power, and still get like 2/3rds of the performance.
Re:Next-Concept Modeling: Fast, Parallel Coarse-to-Fine Text... by bigbadfeline on Monday November 09, 2026 @05:20PM (#50433091)
> So if you had a warehouse full of GPUs, you could just go ahead and install them, run them at low power, and still get like 2/3rds of the performance.

This doesn't add up. First, it's still hoarding, I'd call it lukewarm GPUs as opposed to dark GPUs. Second, nobody would do that because it needs more space and maintenance, more racks, along with the added wear, tear and power supply losses that come with them. How do you people come up with these genius ideas, justifying the documented hardware hoarding [1]?

Here's another fun case, where some GPU hoarders simply forgot about a truckload of GPU's and didn't notice it was missing for full two weeks after it was stolen. It doesn't look like they need GPU's for "urgent installation" [2].

[1] https://www.datacenterdynamics.com/en/news/microsoft-has-ai-...

[2] https://www.tomshardware.com/pc-components/gpus/six-pallets-...

Re:Next-Concept Modeling: Fast, Parallel Coarse-to-Fine Text... by schiffern on Tuesday November 10, 2026 @12:46AM (#50436544)

  >documented hardware hoarding
If you read the actual quote, all they say is that Microsoft isn't bottlenecked by GPUs. The "hardware hoarding" angle is just editorialization by the writer of the article.

  >“The biggest issue we are now having is not a compute glut, but it’s power – it’s sort of the ability to get the builds done fast enough close to power,” Nadella said. “So, if you can’t do that, you may actually have a bunch of chips sitting in inventory that I can’t plug in. In fact, that is my problem today. It’s not a supply issue of chips; it’s actually the fact that I don’t have warm shells to plug into.”

  >His comments echo those made by Microsoft’s CFO Amy Hood on the company’s Q1 2026 earnings call last week, where she told analysts that access to compute hardware has not been a constraint for the hyperscaler
Nothing about GPUs sitting on a shelf somewhere.
Re:Next-Concept Modeling: Fast, Parallel Coarse-to-Fine Text... by torginus on Tuesday November 10, 2026 @03:43AM (#50437637)
Which is the point I was making. One example I managed to find is:

https://www.techpowerup.com/301649/nvidia-geforce-rtx-4090-w...

They get 95% of performance in a game with 60% TDP. I'm not sure how this translates to datacenters, but I suspect You can get at least 75% of the perf from a datacenter GPU running at half power, so it makes sense to install them anyway, and run all your stuff at lower power, as you'd still get 1.5x the perf.

Re:Next-Concept Modeling: Fast, Parallel Coarse-to-Fine Text... by schiffern on Tuesday November 10, 2026 @08:03AM (#50439735)
That seems surprising? I would expect datacenters GPUs are already optimized for that, since it's one of the main difference between how datacenters and gaming GPUs are evaluated.

It should have been trivial to find a source if the assumption was true, which makes me doubt even harder.

Re:Next-Concept Modeling: Fast, Parallel Coarse-to-Fine Text... by owebmaster on Monday November 09, 2026 @09:48AM (#50426404)
Lack of customers*. SpaceXaitwitter has some big beautiful idle datacenters with all GPUs ready to use.