News for hackers. Stuff that matters.
Re:Apache Arrow Datafusion 5.0.0 release by pauldix on Tuesday August 24, 2021 @02:53PM (#28293229)
The new core we're building for InfluxDB (named InfluxDB IOx) uses Datafusion for query execution. We have multiple team members contributing to this release and we're super excited to be involved with it.

I think it's a really exciting time for new OLAP systems because of Arrow, Rust, and the rise of object store + ephemeral compute for analytical and time series data.

Re:Apache Arrow Datafusion 5.0.0 release by houqp on Tuesday August 24, 2021 @02:56PM (#28293265)
Indeed, big shout out to the InfluxDB team!
Re:Apache Arrow Datafusion 5.0.0 release by rektide on Tuesday August 24, 2021 @04:14PM (#28294354)
> the rise of object store + ephemeral compute

Question, does Datafusion itself integrate with Arrow's Plasma object store? Or is it more agnostic?

Re:Apache Arrow Datafusion 5.0.0 release by andygrove on Tuesday August 24, 2021 @06:39PM (#28295870)
There is no support for Plasma. There is a TableProvider API for custom file formats and there is built-in support for CSV, Parquet, and JSON.