Re:Nvidia DGX GH200: The First 100 Terabyte GPU Memory System
by Tepix on Wednesday May 31, 2023 @07:10AM
(#36136907)
Consumer cards only have PCIe 4.0, at most 24GB VRAM and the only recent model with NVLink, the RTX 3090, can only be connected to exactly one other card. It doesn't scale beyond that. So you are limited to PCIe 4.0 x16 speeds.
[ Parent
| on HN ]
Re:Nvidia DGX GH200: The First 100 Terabyte GPU Memory System
by SirFlamenco on Saturday June 03, 2023 @07:14PM
(#36181422)
Technically the A6000 has 48 Gb of VRAM and works in 2-way NVLink.