News for hackers. Stuff that matters.

A comment on DuckDB: Querying JSON files as if they were tables.

Re:DuckDB: Querying JSON files as if they were tables by simonw on Friday March 03, 2023 @04:28PM (#35015270)
> If your JSON file is newline-delimited, DuckDB can parallelize reading.

I'd like to understand more about what that means. Does it use multiple threads each reading from a different position in the file?

[ Parent | on HN ]
Re:DuckDB: Querying JSON files as if they were tables by lnkuiper on Friday March 03, 2023 @04:38PM (#35015382)
DuckDB will use multiple threads for reading the same file. Each thread will read different parts of the file, but the output will be in the order that the file came in due to DuckDB’s order preserving parallelism.
[ Parent | on HN ]