Re:The Tech Stack Behind Keen IO’s Analytics Backend Service
by csarva on Monday November 18, 2013 @04:16PM
(#6757086)
Having written some analytics services myself, I'm curious what sort of performance you're seeing on the ingest side with tornado/python. What kind of throughput per server (or systemwide) are you seeing?
[ Parent
| on HN ]
Re:The Tech Stack Behind Keen IO’s Analytics Backend Service
by dzello on Monday November 18, 2013 @04:25PM
(#6757149)
When we did the migration over to Storm & Cassandra, we did a 1 time ingestion of old events. This was very fast, peaking around 50k events/sec. Additional synthetic testing showed we could easily beat that. It was actually the old system that bottlenecked, and prevented us from turning the dial way up :)
Re:The Tech Stack Behind Keen IO’s Analytics Backend Service
by dkador on Monday November 18, 2013 @04:21PM
(#6757125)
CTO of Keen IO here.
The ingest side isn't too crazy. We're doing between 50-100 insert-type requests per second per server (although we run multiple instances of Tornado per server so it's actually fewer per Tornado process). The stats on the read side are more impressive. :)