News for hackers. Stuff that matters.
Re:ChatGPT Hardware a Look at 8x Nvidia A100 Powering the Tool by jmalicki on Tuesday February 14, 2023 @02:40PM (#34794795)
Two of the biggest differences are ECC memory and virtualization support.
Re:ChatGPT Hardware a Look at 8x Nvidia A100 Powering the Tool by crabbone on Tuesday February 14, 2023 @04:26PM (#34796274)
Yeah, also while ECC is mostly transparent to the software layer, virtualization support is in itself a huge software layer that comes with this kind of equipment. MIG ( https://docs.nvidia.com/datacenter/tesla/mig-user-guide/ ), there's also software made to expose GPU inside containers.

This software is mostly supplied by vendor, and it mostly cares about vendor's tech, and will usually require special features exposed by the hardware, so, won't work with consumer-grade GPUs.

Re:ChatGPT Hardware a Look at 8x Nvidia A100 Powering the Tool by m463 on Tuesday February 14, 2023 @04:50PM (#34796633)
well, and it's a specialized die. A100 ~ 2x size of 3090