News for hackers. Stuff that matters.
Re:Nvidia DGX GH200: The First 100 Terabyte GPU Memory System by prmoustache on Wednesday May 31, 2023 @04:18AM (#36135827)
Why do we still call those processors GPU when they are not meant to process graphics?
Re:Nvidia DGX GH200: The First 100 Terabyte GPU Memory System by tzhenghao on Wednesday May 31, 2023 @04:21AM (#36135848)
Good point. "AI accelerators" is a thing now that competes directly with "GPUs used for AI as its sole purpose".
Re:Nvidia DGX GH200: The First 100 Terabyte GPU Memory System by pixelpoet on Wednesday May 31, 2023 @04:24AM (#36135873)
CPUs are also arguably not the centre of processing in such systems.
Re:Nvidia DGX GH200: The First 100 Terabyte GPU Memory System by ioedward on Wednesday May 31, 2023 @05:08AM (#36136149)
The technical term is GPGPU, general-purpose computing on GPUs, but I like to call them GPUs for short.
Re:Nvidia DGX GH200: The First 100 Terabyte GPU Memory System by moffkalast on Wednesday May 31, 2023 @08:42AM (#36137662)
So, a GPPU.
Re:Nvidia DGX GH200: The First 100 Terabyte GPU Memory System by ru552 on Wednesday May 31, 2023 @11:43AM (#36139648)
A GPU specializes in Vector math, which is what is used in gaming graphics. Hence the name Graphics Processing Unit and it's original use case. It just so happens that LLMs are powered by vector math much like graphics applications are.
Re:Nvidia DGX GH200: The First 100 Terabyte GPU Memory System by prmoustache on Wednesday May 31, 2023 @03:22PM (#36142821)
So it should be called VMPU then, not GPU.