Working with CSV files on shell/terminal

Re:Working with CSV files on shell/terminal by hermitcrab on Wednesday June 28, 2023 @04:15PM (#36511955)

I often has to create small test data files a few rows long. Very easy to do for a CSV file.

[ Parent | on HN ]

Re:Working with CSV files on shell/terminal by wenc on Wednesday June 28, 2023 @05:10PM (#36512659)

Absolutely.

This is also my use case where I have GBs of data in S3 as Parquet and a small CSV file that I have to join them to.

And DuckDB reads CSVs and Parquet and SQLite and others. I can join all these heterogeneous data types in a single SQL statement and have the assurance that it’ll be done correctly.

I believe clickhouse-local can do the same.

[ Parent | on HN ]