News for hackers. Stuff that matters.

A comment on InfluxDB v0.10 GA with hundreds of thousands writes/sec, 98% better compression. Parent comment

Re:InfluxDB v0.10 GA with hundreds of thousands writes/sec, ... by cbsmith on Thursday February 04, 2016 @05:22PM (#11037774)
Massive performance improvements like that tend to come down to overall changes in the data structure and/or algorithm. This is like, "oh yeah, maybe we should do LSM?" or "maybe compressed bitmaps?" kind of stuff. What what the magic?
[ Parent | on HN ]
Re:InfluxDB v0.10 GA with hundreds of thousands writes/sec, ... by CyrusL on Thursday February 04, 2016 @05:27PM (#11037809)
New storage engine.

Introduction from last October: https://influxdata.com/blog/new-storage-engine-time-structur...

[ Parent | on HN ]
Re:InfluxDB v0.10 GA with hundreds of thousands writes/sec, ... by cbsmith on Thursday February 04, 2016 @09:42PM (#11039052)
Oh right, I remember when that blog post came out. It was amusing because I'd built an in-house metric store much like InfluxDB (using a LevelDB engine), and reached much the same inflection point and decision. I so should have open sourced that so you poor saps didn't have to experience my pain.
[ Parent | on HN ]