Every story and comment from the Hacker News API, in a layout borrowed from 2001.
A comment on The Birth of Parquet. Parent comment
Look at the parquet file metadata: use whatever tool you want for that. The Python parquet library is useful and supports s3.
How big are your row groups? If it’s one large row group then you will run into this issue.
What’s the number of rows in each row group?
There are no comments on this comment yet.
Look at the parquet file metadata: use whatever tool you want for that. The Python parquet library is useful and supports s3.
How big are your row groups? If it’s one large row group then you will run into this issue.
What’s the number of rows in each row group?