News for hackers. Stuff that matters.
Re:Max severity RCE flaw discovered in widely used Apache Pa... by twoodfin on Sunday April 06, 2025 @03:49PM (#43604367)
Indeed, given the massive interest Parquet has generated over the past 5 years, and its critical role in modern data infrastructure, I’ve been disappointed every time I’ve dug into the open source ecosystem around it for one reason or another.

I think it’s revealing and unfortunate that everyone serious about Parquet, from DuckDB to Databricks, has written their own “codec”.

Some recent frustrations on this front from the DuckDB folks:

https://duckdb.org/2025/01/22/parquet-encodings.html

Re:Max severity RCE flaw discovered in widely used Apache Pa... by dev_l1x_be on Monday April 07, 2025 @04:01AM (#43609018)
Unfortunately many of the big data libraries are like that and there is no motivation to fix these things. One example is the ORC Java libraries that had 100s of unnecessary dependencies while at the same time importing the filesystem into the format itself.