Re:InfluxDB v0.10 GA with hundreds of thousands writes/sec, ...
by officialchicken on Thursday February 04, 2016 @04:25PM
(#11037362)
"Massively better" doesn't mean deployable to production either. Especially not if you've only tested with a single point of failure with a single sized payload. But I'm willing to give it a third (and final) trial:
1) Does "DELETE * FROM foo" still cause the system to lockup, freeze, and require a restart to free memory? Or are there other conditions/queries that cause the system to become unstable?
2) There's no README/CHANGELOG/dependencies info on the download page. Which is the preferred version of Go to install on my servers for Influxdb - 1.4 or 1.5?
Re:InfluxDB v0.10 GA with hundreds of thousands writes/sec, ...
by jtblin on Friday February 05, 2016 @12:09AM
(#11039617)
I'd guess go version doesn't matter, you should install the binary which is statically linked, no?
Re:InfluxDB v0.10 GA with hundreds of thousands writes/sec, ...
by cbsmith on Thursday February 04, 2016 @05:22PM
(#11037774)
Massive performance improvements like that tend to come down to overall changes in the data structure and/or algorithm. This is like, "oh yeah, maybe we should do LSM?" or "maybe compressed bitmaps?" kind of stuff. What what the magic?
Re:InfluxDB v0.10 GA with hundreds of thousands writes/sec, ...
by CyrusL on Thursday February 04, 2016 @05:27PM
(#11037809)
New storage engine.
Introduction from last October: https://influxdata.com/blog/new-storage-engine-time-structur...
Re:InfluxDB v0.10 GA with hundreds of thousands writes/sec, ...
by cbsmith on Thursday February 04, 2016 @09:42PM
(#11039052)
Oh right, I remember when that blog post came out. It was amusing because I'd built an in-house metric store much like InfluxDB (using a LevelDB engine), and reached much the same inflection point and decision. I so should have open sourced that so you poor saps didn't have to experience my pain.
The next release will focus on improving query performance, but this one still works for many cases.