Re:Retrospective review of Gödel, Escher, Bach (1996) [pdf]
by fulafel on Monday March 29, 2021 @03:24PM
(#26626982)
I feel the oft cited idea of GPUs being the key to the change is a bit exaggerated. They give a modest constant factor of speedup in exchange for more difficult programming model and esoteric hardware requirements, and as such give a chance of frontfrunning CPU computation a bit, but is it really significant if we zoom out a bit in the historical perspective?
[ Parent
| on HN ]
Re:Retrospective review of Gödel, Escher, Bach (1996) [pdf]
by joefourier on Tuesday March 30, 2021 @05:24AM
(#26632599)
CPU performance, especially single-core, has stalled in the last decade while GPU performance has kept improving. On paper, a 3080 has about 100x faster FP32 performance versus a modern gaming CPU, and in practice even considering memory bandwidth you do fully get a speed-bump of one or two orders of magnitude. I would not call that a "modest constant factor".
And a lot of the recent CPU performance gains are due to SIMD and multithreading, which are basically making CPUs more GPU-like, rather than the continuous improvement of serial performance as we've had up until ~2005.