News for hackers. Stuff that matters.
Re:DuckDB 1.0.0 by szarnyasg on Monday June 03, 2024 @10:22AM (#40562902)
DuckDB supports partial reading of Parquet files (also via HTTPS and S3) [1], so it can limit the scans to the required columns in the Parquet file. It can also perform filter pushdown, so querying data in S3 can be quite efficient.

Disclaimer: I work at DuckDB Labs.

[1] https://duckdb.org/docs/data/parquet/overview#partial-readin...

Re:DuckDB 1.0.0 by gizzlon on Monday June 03, 2024 @12:34PM (#40564373)
oooh, cool
Re:DuckDB 1.0.0 by killcoder on Tuesday June 04, 2024 @08:19PM (#40580238)
Does DuckDB supports partial reading of .duckdb files hosted externally?