News for hackers. Stuff that matters.
Re:Nvidia pursues $30B custom chip opportunity with new unit by amelius on Saturday February 10, 2024 @02:52PM (#39329602)
Turns out that demand for graphics memory got stuck at a point where compute is still hungry for more.

That may certainly change but it doesn't help compute much, today.

Re:Nvidia pursues $30B custom chip opportunity with new unit by LoganDark on Saturday February 10, 2024 @10:47PM (#39332497)
It's supply that's down - Nvidia is strictly enforcing their artificial segmentation where the jump from 24GB to 40GB of VRAM multiplies the price by around 5 (!).

They know that if you need a 40GB card, you probably can't use a 24GB card at all because it'd run out of VRAM. They charge such insane prices for those higher capacity cards, because they know that they can make you pay thousands upon thousands for every tiny scrap of extra VRAM, and you will have literally no choice but to pay that price because you need the VRAM.

Demand isn't low, demand is actually so high that they don't care if lowly consumers want VRAM, they already have enterprise customers that need it so badly that they'll pay prices higher than most consumers would ever imagine.

And that's why they're so stingy with VRAM on the consumer cards. They need to be careful not to accidentally make them useful in the datacenter, so they can ensure that their enterprise customers continue to be forced to pay those extortionary prices.

You see, it's all about the money, and it always will be. Capitalism, baby!

Re:Nvidia pursues $30B custom chip opportunity with new unit by amelius on Sunday February 11, 2024 @11:39AM (#39336160)
You need a special license to run nVidia cards in the datacenter, so this rules out consumer gaming cards already.
Re:Nvidia pursues $30B custom chip opportunity with new unit by LoganDark on Thursday February 15, 2024 @07:11PM (#39391201)
There are already ways to get around this. For example, renting compute from people who aren't in datacenters. Which is already a thing: https://vast.ai