Re:Nvidia Unveils GeForce RTX 30 Series GPUs
by Const-me on Tuesday September 01, 2020 @08:49PM
(#24348871)
Not an expert in ML, but I don’t think CUDA uses SLI at all.
SLI is specific to rendering. Depending on the workload, it’s sometimes makes perfect sense to split GPGPU jobs into multiple GPUs. An extreme example of that approach is crypto-currency miners who sometimes use a dozen of GPUs in a single computer.
The only limitation, the working set used by each GPU needs to fit in VRAM of that GPU, otherwise GPUs gonna bottleneck on I/O as opposed to compute, will be very slow. For ML, this means the setup of two 3080 GPUs will be limited to 10GB model sizes.
SLI is specific to rendering. Depending on the workload, it’s sometimes makes perfect sense to split GPGPU jobs into multiple GPUs. An extreme example of that approach is crypto-currency miners who sometimes use a dozen of GPUs in a single computer.
The only limitation, the working set used by each GPU needs to fit in VRAM of that GPU, otherwise GPUs gonna bottleneck on I/O as opposed to compute, will be very slow. For ML, this means the setup of two 3080 GPUs will be limited to 10GB model sizes.