Re:Computing Performance on the Horizon
by zozbot234 on Monday July 05, 2021 @04:15PM
(#27741453)
Memory bandwidth is just barely trying to keep up with cores, frequencies and IPC amounts. Bandwidth available per core is still going to drop. So newer development workflows that optimize for this bottleneck are going to be very relevant.
[ Parent
| on HN ]
Re:Computing Performance on the Horizon
by oscardssmith on Tuesday July 06, 2021 @01:34AM
(#27744542)
One thing that I think this will mean is the end of blas. Blas served us well for about 50 years, but one of the big problems it has is that it leads to code that takes multiple passes over memory. I think the future lies in systems that do code generation to better fuse loops of arbitrary code together. LoopVectorization.jl for example is able to generate blas level code for arbitrary computation, and as such can often be faster than blas since you don't have to use one of the specific hand optimized kernels.
Re:Computing Performance on the Horizon
by dragontamer on Monday July 05, 2021 @05:12PM
(#27741859)
Memory bandwidth does improve at least.
Latency hasn't improved for the last 30 years. Tricks like SMT which can help mitigate the latency issue seem like the way forward.