News for hackers. Stuff that matters.
Re:Apache Arrow is 10 years old by nu11ptr on Thursday February 12, 2026 @10:31AM (#46990045)
If I recall, Arrow is more or less a standardized representation in memory of columnar data. It tends to not be used directly I believe, but as the foundation for higher level libraries (like Polars, etc.). That said, I'm not an expert here so might not have full info.
Re:Apache Arrow is 10 years old by tormeh on Thursday February 12, 2026 @10:41AM (#46990187)
You can absolutely use it directly, but it is painful. The USP of Arrow ist that you can pass bits of memory between Polars, Datafusion, DuckDB, etc. without copying. It's Parquet but for memory.
Re:Apache Arrow is 10 years old by skeeter2020 on Thursday February 12, 2026 @10:46AM (#46990251)
This is true, and as a result IME the problem space is much smaller than Parquet, but it can be really powerful. The reality is most of us don't work in environments where Arrow is needed.