News for hackers. Stuff that matters.

A comment on Working with CSV files on shell/terminal. Parent comment

Re:Working with CSV files on shell/terminal by hermitcrab on Wednesday June 28, 2023 @04:03PM (#36511822)
It is useful to be able to create, view or edit data in a standard text editor though.
[ Parent | on HN ]
Re:Working with CSV files on shell/terminal by theLiminator on Wednesday June 28, 2023 @04:06PM (#36511863)
Edits might be a little tricky, there's no concept of writing in place in parquet afaict. But there's absolutely no reason why reads/creation can't be supported in text editors (I'm sure some do).
[ Parent | on HN ]
Re:Working with CSV files on shell/terminal by hermitcrab on Wednesday June 28, 2023 @04:15PM (#36511955)
I often has to create small test data files a few rows long. Very easy to do for a CSV file.
[ Parent | on HN ]
Re:Working with CSV files on shell/terminal by wenc on Wednesday June 28, 2023 @05:10PM (#36512659)
Absolutely.

This is also my use case where I have GBs of data in S3 as Parquet and a small CSV file that I have to join them to.

And DuckDB reads CSVs and Parquet and SQLite and others. I can join all these heterogeneous data types in a single SQL statement and have the assurance that it’ll be done correctly.

I believe clickhouse-local can do the same.

[ Parent | on HN ]