Re:Nvidia's RTX Pro 6000 has 96GB of VRAM and 600W of power
by etiam on Tuesday March 18, 2025 @04:11PM
(#43404447)
Does that mean it's perfectly feasible to have more if one accepts a higher latency? Seems like there could be plenty of use cases where that's preferable.
[ Parent
| on HN ]
Re:Nvidia's RTX Pro 6000 has 96GB of VRAM and 600W of power
by codedokode on Tuesday March 18, 2025 @04:13PM
(#43404481)
GDDR chips already have very high latency.
Re:Nvidia's RTX Pro 6000 has 96GB of VRAM and 600W of power
by Lramseyer on Tuesday March 18, 2025 @05:23PM
(#43405320)
Not exactly. The name of the game with GDDR memory is "speed on the cheap." To do this, it uses a parallel bus with data rates pushed to the max. Not much headroom for things that could compromise signal integrity like socketed parts, or even board traces longer than they absolutely need to be. That's why the DRAM modules are close to the GPU and they're always soldered down.
Also, the latency with GDDR7 is pretty terrible. It uses PAM3 signaling with a cursed packet encoding scheme. At least they were nice enough to add in a static data scrambler this time around! The lack of RLL was kind of a pain in GDDR6.