Re:The Billion Row Challenge (1BRC) – Step-by-Step from 71s ...
by e12e on Thursday February 22, 2024 @12:17PM
(#39470106)
Thank you for taking the time to write it up. Really nice to see some modern Java, as well as the ideas with comments - many of which seem to generalize quite well - beyond Java and the jvm.
Re:The Billion Row Challenge (1BRC) – Step-by-Step from 71s ...
by fearthetelomere on Thursday February 22, 2024 @05:00PM
(#39473905)
If you do find the time, I'm sure that writeup would be very valuable!
I took part in the One Billion Row challenge (1BRC). It was a lot of fun, but also a great learning experience. People came up with some pretty incredible optimization tricks. When you put them all together, it's a huge number, and they are all mingled up in individual solutions. They also happen on many levels -- from quite high, to incredibly low and detailed.
In retrospect, I could see there was a good number of tricks that are relatively easy to grasp, and reusable in other projects. I felt the urge to do a writeup that captures this knowledge in one place, isolating and explaining each of the tricks.