News for hackers. Stuff that matters.
Re:How GPU Computing Works [video] by boberoni on Tuesday July 12, 2022 @04:14PM (#32075039)
> (Almost) Nobody (really) cares about flops ...because we should really be caring about memory bandwidth

In university, I was shocked to learn in a database class that CPU costs are dwarfed by the I/O costs in the memory hierarchy. This was after spending a whole year on data structures and algorithms, where we obsessed over runtime complexity and # of operations.

It seems that the low-hanging fruit of optimization is all gone. New innovations for performance will have to happen in transporting data.

Re:How GPU Computing Works [video] by malnourish on Tuesday July 12, 2022 @04:31PM (#32075262)
At the risk of being flippant, I hope you learned about space complexity and the lessons behind how the algorithms and data structures you use impact performance via the cache.
Re:How GPU Computing Works [video] by bogomipz on Tuesday July 12, 2022 @07:04PM (#32076928)
I don't really understand your comment. Databases are generally I/O bound workloads, almost by definition of what they do. Regardless, data structures and algorithms are equally important in databases. B-Trees, linked-lists, buffers, LSM Trees, Bloom filters, caching strategies etc are all fundamental to databases. At any rate for a long time now the low hanging fruit of optimization has been throwing money and hardware at problems - NAND Flash, more cores, larger caches, tons of memory, edge networks etc. Those options are all still there.
Re:How GPU Computing Works [video] by vladf on Tuesday July 12, 2022 @04:53PM (#32075542)
Compression converts I/O bottlenecks to compute ones again.
Re:How GPU Computing Works [video] by Sherl on Tuesday July 12, 2022 @04:58PM (#32075590)
There is an entire field of parallel algorithms which makes use of sequential algorithms to overcome some of these issues. So no it's not wasted. You would apply the knowledge to build parallel algorithms.

There are projects in my school where we implemented a combination of CUDA and openMP in some and MPI+OpenMP in a few. I think the bottleneck is always gonna be there, its just how much and how you deal with it in hardware from the software front.