Re:AMD Lists Threadripper 3000 CPU with 32 Cores, Possible N...
by frankling_ on Thursday October 17, 2019 @05:09PM
(#21286383)
That has never been true: on NVIDIA hardware the 32 threads of each Warp run in lockstep, certainly not all threads. And starting with Volta, each thread even got its own program counter and call stack.
That's not exactly true. The GPU equivalent of a CPU core is called a Streaming Multiprocessor (in NVIDIA language), and it's latest GPU, GTX 2080 has 72 of them.
Each of these SMs can run hundreds of threads, but they run the same code in lock-step.