News for hackers. Stuff that matters.

A comment on Apache Arrow 3.0. Parent comment

Re:Apache Arrow 3.0 by alisonkisk on Wednesday February 03, 2021 @11:35PM (#26022644)
gzip probably would have been fine for that case even without parquet?
[ Parent | on HN ]
Re:Apache Arrow 3.0 by prepend on Thursday February 04, 2021 @07:03AM (#26024640)
Gzip did help, but not as much as parquet. I don’t remember the exact sizes but I think parquet was was 3GB->20MB and gzip was like 3GB->180MB or something.

Also gzip was an extra step of unzip then read.

[ Parent | on HN ]