Re:EU Grabs ARM for First ExaFLOP Supercomputer, x86 Misses Out
by wang_li on Friday October 06, 2023 @04:16PM
(#37795764)
It's highly likely that a workload that is suitable to run on hundreds of disparate computers with thousands of CPU cores is going to be equally well suited for running on tens of thousands of GPU compute threads.
Re:EU Grabs ARM for First ExaFLOP Supercomputer, x86 Misses Out
by atq2119 on Friday October 06, 2023 @05:38PM
(#37796778)
Not necessarily. GPUs simply aren't optimized around branch-heavy or pointer-chasey code. If that describes the inner loop of your workload, it just doesn't matter how well you can parallelize it at a higher level, CPU cores are going to be better than GPU cores at it.
> Seems stupid to use millions of dollars of supercomputer time just because you can't be bothered to get a few phd students to spend a few months rewriting in CUDA...
Rewriting code in CUDA won’t magically make workloads well suited to GPGPU.