News for hackers. Stuff that matters.
Re:Flavors of SIMD by dragontamer on Wednesday February 20, 2019 @05:33PM (#19212757)
> True, saturating a GPU is actually really really hard.

That's true, but GPUs have over 100x the FLOPs of a CPU.

This means that if you write a GPU-program with only 5% utilization (that's 95% idle), you still are going to be 5x faster than a perfectly utilized CPU.

When you have 100x the raw FLOPs and 10x the memory bandwidth... you can write a program that only utilizes 15% of a GPU and still end up with results way faster than any CPU would give you.

--------

CPUs are way easier to program though. CPUs actively look for work to do on your behalf: its like there's an optimization engine built into the chip itself (out-of-order scheduler, branch prediction, etc. etc.). So achieving high-utilization on CPUs is an easier job (but still hard).

There are no comments on this comment yet.