News for hackers. Stuff that matters.
Re:Self-host analytics for better privacy and accuracy by shermozle on Monday May 09, 2016 @06:24PM (#11663709)
MySQL
Re:Self-host analytics for better privacy and accuracy by driverdan on Tuesday May 10, 2016 @12:31AM (#11665158)
It can scale pretty far before it becomes an issue. Years ago I ran it on our main DB for sites that got over 1 million visits a month with no noticeable overhead. If I had it on its own server with its own DB it could have handled far more traffic.
Re:Self-host analytics for better privacy and accuracy by rhizome on Monday May 09, 2016 @06:54PM (#11663891)
I see. What is the upper bound of "big volume of data" possible under MySQL + Piwik?
Re:Self-host analytics for better privacy and accuracy by shermozle on Monday May 09, 2016 @08:35PM (#11664412)
That's a difficult thing to answer. However the more important problem is loss of data whenever your DB isn't available due to downtime, upgrade etc. It depends how important data loss is for your user case. I'm a data completist but I'm in therapy for it ;)

It's definitely worth playing with, and trivially easy to spin up. Other self-hosted options aren't anything like as simple to get up and running.

Re:Self-host analytics for better privacy and accuracy by rhizome on Monday May 09, 2016 @08:54PM (#11664503)
Well, but the point was MySQL + Piwik "does not scale" and that it's "expensive" besides, which doesn't comport with my experience and sounds like received wisdom.
Re:Self-host analytics for better privacy and accuracy by lucb1e on Tuesday May 10, 2016 @02:44AM (#11665544)
I think if your database is down you've typically got bigger problems than your analytics.
Re:Self-host analytics for better privacy and accuracy by mattab on Tuesday May 10, 2016 @07:34AM (#11666446)
I've worked on Piwik servers tracking & processing reports for up to 800 million pageview per month on hundreds of medium and larger websites.
Re:Self-host analytics for better privacy and accuracy by toomuchtodo on Monday May 09, 2016 @06:28PM (#11663729)
Put Rabbit or Kafka in front of MySQL then?
Re:Self-host analytics for better privacy and accuracy by nacs on Monday May 09, 2016 @06:52PM (#11663884)
They have a Redis-based solution to sit in front of mySQL (seems to be a "Pro" feature though):

https://piwik.org/faq/how-to/faq_19738/

Re:Self-host analytics for better privacy and accuracy by moehm on Monday May 09, 2016 @07:02PM (#11663940)
It's not a Pro feature as in you have to pay for it. It's developed by the devs at piwik.pro, but you can download it for free.