Re:I wrote one of the fastest DataFrame libraries
by SatvikBeri on Sunday March 14, 2021 @01:58AM
(#26453363)
What specifically are you thinking of?
The non-const global variables stand out to me, but I'm not experienced enough tell whether that would make a large difference.
Re:I wrote one of the fastest DataFrame libraries
by tkoolen on Sunday March 14, 2021 @03:50AM
(#26453513)
Non-const globals could be an issue, but it's possible it doesn't matter too much for this particular benchmark. I'm a little worried about taking compilation time (apart from precompilation) into account (would that also be done for C++ code?). But I must confess I maybe posted my comment a bit too soon, partially because of the time of day, partially because of the semicolons at the end of each line in the code, which made me quickly think the benchmark writer was using Julia for the first time. While I have a good amount of experience with Julia, I don't have that much experience with DataFrames.jl itself, so I don't know for sure whether the reported benchmark times are reasonable or not.
The Julia benchmark two links deep at https://github.com/h2oai/db-benchmark doesn't follow even the most basic performance tips listed at https://docs.julialang.org/en/v1/manual/performance-tips/.