News for hackers. Stuff that matters.
Re:Apache Arrow Datafusion 5.0.0 release by rektide on Tuesday August 24, 2021 @04:14PM (#28294354)
> the rise of object store + ephemeral compute

Question, does Datafusion itself integrate with Arrow's Plasma object store? Or is it more agnostic?

Re:Apache Arrow Datafusion 5.0.0 release by andygrove on Tuesday August 24, 2021 @06:39PM (#28295870)
There is no support for Plasma. There is a TableProvider API for custom file formats and there is built-in support for CSV, Parquet, and JSON.