Re:InfluxDB Clustering Beta and Data Explorer
by pauldix on Thursday June 23, 2016 @02:32PM
(#11963326)
After 1.0 is released our two highest priorities are to handle high cardinality data sets (on disk and in memory inverted index) and continuous queries that are more automatic (downsample everything and give users the option for query results that scale automatically like Graphite)
Re:InfluxDB Clustering Beta and Data Explorer
by mattbillenstein on Thursday June 23, 2016 @04:33PM
(#11964090)
Right on -- for the record, this data is ending up in mongodb at the moment, so I need to write logic for binning by time and so forth myself. Our use case is maybe odd in this space -- sampling a handful of values per item a couple times a day, but for millions of items.
I compared a dataset to postgres and the new mongo storage engine is very good -- dunno if wiredTiger is something you guys are looking at, but it's very compact and fast to query with the proper indexes.
Dumped some stats into a gist as well: https://gist.github.com/mattbillenstein/89969980025414e2bca8...
i had a similar issue with mongo and time series data. for special purpose event data like that gist, i think you should consider using a column store.
Re:InfluxDB Clustering Beta and Data Explorer
by mattbillenstein on Thursday June 23, 2016 @06:18PM
(#11964710)
I may eventually -- we're using mongo for the rest of the metadata for now, so this is good enough to not need something else at the moment.
https://docs.influxdata.com/influxdb/v0.10/guides/hardware_s...
Show stopper if you're in the same boat that I am.