Re:Self-host analytics for better privacy and accuracy
by rhizome on Monday May 09, 2016 @05:21PM
(#11663334)
Why isn't it scalable?
[ Parent
| on HN ]
Re:Self-host analytics for better privacy and accuracy
by shermozle on Monday May 09, 2016 @06:24PM
(#11663709)
MySQL
Re:Self-host analytics for better privacy and accuracy
by driverdan on Tuesday May 10, 2016 @12:31AM
(#11665158)
It can scale pretty far before it becomes an issue. Years ago I ran it on our main DB for sites that got over 1 million visits a month with no noticeable overhead. If I had it on its own server with its own DB it could have handled far more traffic.
Re:Self-host analytics for better privacy and accuracy
by rhizome on Monday May 09, 2016 @06:54PM
(#11663891)
I see. What is the upper bound of "big volume of data" possible under MySQL + Piwik?
Re:Self-host analytics for better privacy and accuracy
by shermozle on Monday May 09, 2016 @08:35PM
(#11664412)
That's a difficult thing to answer. However the more important problem is loss of data whenever your DB isn't available due to downtime, upgrade etc. It depends how important data loss is for your user case. I'm a data completist but I'm in therapy for it ;)
It's definitely worth playing with, and trivially easy to spin up. Other self-hosted options aren't anything like as simple to get up and running.
Re:Self-host analytics for better privacy and accuracy
by rhizome on Monday May 09, 2016 @08:54PM
(#11664503)
Well, but the point was MySQL + Piwik "does not scale" and that it's "expensive" besides, which doesn't comport with my experience and sounds like received wisdom.
Re:Self-host analytics for better privacy and accuracy
by lucb1e on Tuesday May 10, 2016 @02:44AM
(#11665544)
I think if your database is down you've typically got bigger problems than your analytics.
Re:Self-host analytics for better privacy and accuracy
by mattab on Tuesday May 10, 2016 @07:34AM
(#11666446)
I've worked on Piwik servers tracking & processing reports for up to 800 million pageview per month on hundreds of medium and larger websites.
Re:Self-host analytics for better privacy and accuracy
by toomuchtodo on Monday May 09, 2016 @06:28PM
(#11663729)
Put Rabbit or Kafka in front of MySQL then?