News for hackers. Stuff that matters.
Re:Apache Arrow 3.0 by CameronNemo on Wednesday February 03, 2021 @11:10PM (#26022478)
Parquet is not Arrow. Parquet has optimizations for storage size at the expense of compute readiness. Arrow maximizes computation efficiency, at the expense of storage size.

Read more here: https://stackoverflow.com/questions/56472727/difference-betw...

Re:Apache Arrow 3.0 by prepend on Thursday February 04, 2021 @06:59AM (#26024622)
I used arrow to read and write parquets across environments. Thats my dumb reason for finding arrow so useful.