News for hackers. Stuff that matters.

A comment on A love letter to the CSV format. Parent comment

Re:A love letter to the CSV format by IanCal on Thursday March 27, 2025 @07:29AM (#43492489)
Yes, it's not great. Space is annoying, though compression pretty much removes that as a concern (zstd is good for this, you can even have a custom dictionary). And yes, missing keys is annoying.

JSONL is handy, JSON that's in the form {data: [...hundred megs of lines]} is annoying for various parsers.

I'm quite a fan of parquet, but never expect to receive that from a client (alas).

[ Parent | on HN ]
Re:A love letter to the CSV format by cogman10 on Thursday March 27, 2025 @08:59AM (#43493140)
Parquet should get the praise. It's simply awesome.

It's what I'd pick for tabular data exchange.

A recent problem I solved with it and duckdb allowed me to query and share a 3M record dataset. The size? 50M. And my queries all ran subsecond. You just aren't going to get that sort of compression and query-ability with a csv.

[ Parent | on HN ]
Re:A love letter to the CSV format by Izkata on Thursday March 27, 2025 @10:29AM (#43494053)
> JSON that's in the form {data: [...hundred megs of lines]} is annoying for various parsers.

One reason this became common was a simple protection against json hijacking: https://haacked.com/archive/2009/06/25/json-hijacking.aspx/

[ Parent | on HN ]