News for hackers. Stuff that matters.

A comment on Modern CSV version 2 is now available. Parent comment

Re:Modern CSV version 2 is now available by djbusby on Tuesday August 15, 2023 @07:54PM (#37140941)
Have you tried the trick where you put CSV into SQLite?

I do that. Many, maybe linked, CSVs. Load all into SQLIte, query, filter, sort, etc.

In the repos to process we have only scripts to load and filter. The SQLite things are short lived.

Also, memory only SQLite FTW!

[ Parent | on HN ]
Re:Modern CSV version 2 is now available by TristanBall on Tuesday August 15, 2023 @09:15PM (#37141588)
Duckdb does this straight from csv. You can treat them pretty much just like un-indexed tables, including queries, joins and output back to csv or parquet. its

Really nice.

[ Parent | on HN ]