News for hackers. Stuff that matters.
Re:I wrote one of the fastest DataFrame libraries by cfourpio on Sunday March 14, 2021 @12:36AM (#26453057)
Would you mind pointing me at a resource that explains how J/Jd handle it by comparison?
Re:I wrote one of the fastest DataFrame libraries by rscho on Sunday March 14, 2021 @01:52AM (#26453342)
https://code.jsoftware.com/wiki/Jd/Overview

Jd only packs int vectors, though. So if you're hoping for string compression then I don't know of any free solution. Jd heavily leverages SIMD and mmap. Larger-than RAM columns can be easily processed by ftable. I use Jd for data wrangling before making models in R. Of course, the J language is not for the faint of heart but it's really well-suited to the task.