Safely Rewriting Mixpanel’s Highest-Throughput Service

Re:Safely Rewriting Mixpanel’s Highest-Throughput Service by paladinxx on Saturday July 27, 2019 @01:46AM (#20540590)

I think the parent may have meant the opposite of how you interpreted it... That writing a tsd db from scratch doesn't match what you just stated about investing engineering time where it makes the most sense.

[ Parent | on HN ]

Re:Safely Rewriting Mixpanel’s Highest-Throughput Service by i0exception on Saturday July 27, 2019 @02:16AM (#20540667)

We don't run a TSDB. A TSDB doesn't work for the kinds of queries we run - specifically, TSDBs don't work if you want to

  * analyze every datapoint you receive
  * when the dimensional cardinality is high
  * you want to analyze behaviors over time (e.g. the output depends on the orders of events followed - like creating a funnel report)

There's no off-the-shelf solution that does this at the scale at which we operate - hence the need to write our own custom solution.

[ Parent | on HN ]