Re:JDF.jl – Julia DataFrames serialization format
by tjrgergw on Saturday July 15, 2023 @05:44AM
(#36735130)
What exactly is the advantage of this vs Arrow.jl?
[ Parent
| on HN ]
Re:JDF.jl – Julia DataFrames serialization format
by ChrisRackauckas on Saturday July 15, 2023 @07:43AM
(#36735668)
If I'm not mistaken, Arrow is an in-memory format and not necessarily a storage format. Though it is common to use Arrow with the Parquet serialization format, and the benchmarks here show a much faster read performance than Parquet while achieving around the same file size. From my read, that seems to be the impetus for the project (with comparisons made on Linkedin by the author as well) and so in theory Arrow and this could be complementary like Arrow and Parquet if someone setup the links.
Re:JDF.jl – Julia DataFrames serialization format
by zokier on Saturday July 15, 2023 @08:41AM
(#36736078)
* * *