Re:Why CSV is still king
by 0cf8612b2e1e on Thursday August 01, 2024 @11:38PM
(#41135905)
I routinely interface with 1GB+ csvs. The size explosion for json would be huge. Disk IO aside, I assume a json parser is going to be slower to parse than csv.
[ Parent
| on HN ]
Re:Why CSV is still king
by imtringued on Friday August 02, 2024 @03:33AM
(#41136850)
How would JSON cause a size explosion?
Nothing prevents you using ndjson where you define a header and then have an array per line.
Re:Why CSV is still king
by 0cf8612b2e1e on Friday August 02, 2024 @01:51PM
(#41140980)
Nobody does this currently. You have now created another bespoke format. If I am going to need a custom parser/writer, I might as well lean on a binary format that has far stronger properties than a text based one.
Re:Why CSV is still king
by ianburrell on Friday August 02, 2024 @11:54PM
(#41144579)
JSONL is pretty common format. It makes sense for logs and anything else written incrementally.
JSON parsers are super common. They are simpler and faster than CSV because it is more regular. JSONL is simple to implement cause write by record and read by line.
The only difference with CSV are bracket characters around line and every string has quotes. The benefit is clear escaping rules including for newlines.
Re:Why CSV is still king
by 0cf8612b2e1e on Saturday August 03, 2024 @02:02PM
(#41148141)
JSONL is standard. Upthread said to write the header row and then make subsequent rows arrays. Of which I am not aware of anything that does this currently.
My objection to JSONL was about the increase in file size owing to repeating the keys.
Re:Why CSV is still king
by ianburrell on Saturday August 03, 2024 @03:48PM
(#41148783)
JSON can write arrays in addition to hashes. JSON arrays are nearly identical to CSV. The only difference is brackets around li;es. There is no extra space wasted for keys.
Why do you use a text-based format at all at that size?
Re:Why CSV is still king
by 0cf8612b2e1e on Friday August 02, 2024 @06:06PM
(#41143073)
You get what you get. Presumably when it started, they were a more modest size.