scale8

More around the storing of data. This is why Scale8.com is on EU servers...

The reason we built Scale8.com - Time to replace Google Analytics and Google Tag Manager :)

This is why we built Scale8.com !

An open-source and privacy-friendly alternative to Google Analytics & Google Tag Manager :)

GA is simply not compliant...

https://scale8.com/blog/is-ga-gdpr-compliant/

Good to hear we are not the only ones!

We think self-hosted might be the right direction. We are going to be putting a ton of effort and energy into our self-hosted offering over the next 6-12 months. We want to support all the major databases. At present we only have MongoDB (not idea for large projects) and BigQuery, although Clickhouse is not too far off now.

This exactly what this is :) - Without some basic analytics you are flying blind, but that shouldn't come at the cost of your visitors privacy either.

We use our own platform internally and I'm not sure how we'd get on without analytics in all honestly.

I agree. We actually chose Java due to support within the community. Our first choice was Rust :)

It would not be a huge project to convert to Go or Rust though.

Hey @ramoz, great question. Materialized views have quite a few limitations. We have explored a few solutions using them.

https://cloud.google.com/bigquery/docs/materialized-views-in...

We might still introduce them in a future release to optimise a few queries.

Two years ago we started with Clickhouse - we also built the aggregation pipelines around this. For data ingest we have a variety of different solutions, but at present stream to BigQuery for simplicity rather than anything else.

We will be bringing Clickhouse back soon (we are speaking to them at the moment!) as we try and find a way that would enable those wishing to self-host to have a simple and scalable setup.

Our goal is to support the self-hosed version as we believe that will help the community thrive.

I'd suggest a minimum of 2GB ram. The data collection is done via Java (Micronaut project). While it can cope with thousands of requests per second quite happily on a single instance, it does require a bit of ram.

Thanks for your comment @drudoo.

We have it all available to run via docker-compose. There is a nice one liner to spin it up and have a look. There is also commercial version should you not want to manage the infrastructure yourself.

That being said... we will be releasing multiple cloud setups via Terraform for the self hosted version. We had a call with Clickhouse Cloud yesterday and that is set for a release in September - we'll aim to align with that and shortly after provide a full IAC setup.

Thank you for posting that :)