News for hackers. Stuff that matters.
Re:Parquet: More than just “Turbo CSV” by chrismorgan on Monday April 03, 2023 @11:36PM (#35434719)
There are also significant disadvantages to text formats, most obviously in the area of compatibility. They’re easy enough that people have a dreadful habit of ignoring specs (if they even exist) and introducing incompatibilities, which are not uncommonly even security vulnerabilities (e.g. HTTP request smuggling).

CSV is a very good demonstration of these problems.

Binary formats tend to be quite a bit more robust, with a much higher average quality of implementation, because they’re harder to work with.

Re:Parquet: More than just “Turbo CSV” by never_inline on Monday April 03, 2023 @11:58PM (#35434855)
> because they’re harder to work with

Or rather because parsing human readable text comes with many edge cases, than encoding stuff into binary.

Re:Parquet: More than just “Turbo CSV” by chrismorgan on Tuesday April 04, 2023 @01:53AM (#35435638)
It’s easy enough to write an exact spec. People are just much less inclined to, and even if they do people are much less inclined to follow it.