News for hackers. Stuff that matters.
Re:SIMD < SIMT < SMT: Parallelism in Nvidia GPUs (2011) by raphlinus on Tuesday June 11, 2024 @06:07PM (#40652174)
There's a bit more information at [1], but I think the details are not public. The hardware is tracking a separate program counter (and call stack) for each thread. So in the CAS example, one thread wins and continues making progress, while the other threads loop.

There seems to some more detail in a Bachelors thesis by Phillip Grote[2], with lots of measurements of different synchronization primitives, but it doesn't go too deep into the hardware.

[1]: https://arxiv.org/abs/2205.11659

[2]: https://www.clemenslutz.com/pdfs/bsc_thesis_phillip_grote.pd...

Re:SIMD < SIMT < SMT: Parallelism in Nvidia GPUs (2011) by xoranth on Tuesday June 11, 2024 @06:31PM (#40652400)
Thanks!