Re:OpenTSDB – A Distributed, Scalable Time Series Database
by rodionos on Tuesday December 22, 2015 @01:36AM
(#10776238)
Not sure if your Java comment is warranted, a lot of Apache projects are either written in Java or run on JVM. Yes, HBase's memstore can be optimized, in particular for small key values, but that doesn't negate a need for time-series databases with proven scaling. HDFS offers that. How you were planning to design your tables in PostreSQL if you have 1m+ unique series inserting at 100K+/sec. Assuming you use timestamp as a PK does it translate into 1m+ tables?
[ Parent
| on HN ]
Re:OpenTSDB – A Distributed, Scalable Time Series Database
by dschiptsov on Tuesday December 22, 2015 @03:35AM
(#10776552)
We have already seen how Cassandra clone in C++ perform.
I think that adding a new indexing strategy to a decent engine could be a good idea.
Informix did this.
Re:OpenTSDB – A Distributed, Scalable Time Series Database
by kev009 on Tuesday December 22, 2015 @04:42AM
(#10776732)
Mapr has an HBase compatible stack in C++, I would love to see TSDB numbers on that. TSDB is pretty efficient itself and since metrics collection is such a batchy operation JVM isn't really that much of a problem. You can run some dedicated TSDs for front end/UIs to ameliorate JVM pain there too.
Re:OpenTSDB – A Distributed, Scalable Time Series Database
by rodionos on Tuesday December 22, 2015 @06:16AM
(#10777043)
Do you mean Informix Time-Series Extension? It's been around for a while so maybe there are existing things that came out of IBM recently. Last time I checked its schema it was basically storing serie as a blob not unlike OPC historians like Pi.