Mispredicted branches can multiply your running times

Re:Mispredicted branches can multiply your running times by sv_h1b on Wednesday October 16, 2019 @01:46PM (#21273141)

GPUs are designed to do massive parallel computations which all branch one way and don't have much (any?) branch prediction logic.

You trade it off with increased code size which might spill the cache but for small tight loops not exceeding the cache line/ size it would still be a good win.

[ Parent | on HN ]

Re:Mispredicted branches can multiply your running times by ScottFree on Wednesday October 16, 2019 @04:23PM (#21275089)

Would there be any benefit to adding branch prediction logic to a GPU?

[ Parent | on HN ]

Re:Mispredicted branches can multiply your running times by rdc12 on Wednesday October 16, 2019 @05:53PM (#21276312)

You would probably get some benefit on a per CUDA core basis, but the extra space required would mean less CUDA cores, overall it would probably be a net loss on problems well suited to GPU acceleration

[ Parent | on HN ]