InfluxDB is betting on Rust and Apache Arrow for next-gen data store

Re:InfluxDB is betting on Rust and Apache Arrow for next-gen... by pauldix on Tuesday November 10, 2020 @08:38PM (#25054602)

Yes, absolutely. There are the Arrow libraries in Rust that we're already contributing to. DataFusion, for example is an SQL execution engine.

We'll be publishing crates for parsing InfluxDB Line Protocol, Reading InfluxDB TSM files (for conversion into Parquet and other formats), and client libraries as well.

The entire project itself will also be published as a crate. So you can use any part of the server in your own project.

[ Parent | on HN ]

Re:InfluxDB is betting on Rust and Apache Arrow for next-gen... by jstrong on Tuesday November 10, 2020 @11:16PM (#25055458)

cool. interested to see the TSM library.

if it's any use to you, here's an unpublished rust influx client crate I've been using for a few years. the main point of interest is an ergonomic macro to construct measurements, `measure!`. https://github.com/jonathanstrong/influx-writer

[ Parent | on HN ]