Re:The One Billion Row Challenge
by londons_explore on Thursday January 04, 2024 @10:15AM
(#38867948)
The goal is that none of the intermediate data spills - the only user of RAM is reading the input data.
But for that, you're right, the workload must be split across as many cores as necessary to keep DRAM maxed out or you're throwing away performance. Luckily this problem is easily split.
But for that, you're right, the workload must be split across as many cores as necessary to keep DRAM maxed out or you're throwing away performance. Luckily this problem is easily split.