News for hackers. Stuff that matters.
Re:Apache Arrow 3.0 by prepend on Thursday February 04, 2021 @07:03AM (#26024640)
Gzip did help, but not as much as parquet. I don’t remember the exact sizes but I think parquet was was 3GB->20MB and gzip was like 3GB->180MB or something.

Also gzip was an extra step of unzip then read.

There are no comments on this comment yet.