Re:Apache Arrow 3.0
by IshKebab on Thursday February 04, 2021 @01:36PM
(#26028357)
I don't know whether it is a limitation of the format or of the implementation. I used the C++ library (or maybe it was C, I can't remember), which I assume PyArrow uses too.
> hence the default on-disk compression
No, Parquet doesn't support some compression formats that Arrow does.
> hence the default on-disk compression
No, Parquet doesn't support some compression formats that Arrow does.