News for hackers. Stuff that matters.

A comment on Ask HN: Suitable database to store web analytics data for million insertion.

Re:Ask HN: Suitable database to store web analytics data for... by openplatypus on Monday April 10, 2023 @02:14PM (#35515406)
Depends on the use case.

You will find folks recommending Clickhouse.

We use Kafka and Elasticsearch with Wide Angle Analytics.

Kafka gives us scalable and cheap storage potential. Kafka Streams means we can easily create "live" aggregates.

Elastic search gives us fast data discoverability.

We chose our stack because of existing expertise in the team.

Is this the easiest setup? No.

Is it scalable? Yes.

Is it cheap? Can be.

[ Parent | on HN ]
Re:Ask HN: Suitable database to store web analytics data for... by openplatypus on Monday April 10, 2023 @02:17PM (#35515449)
A word of warning. Running managed Kafka and Elasticsearch quickly become expensive. The worst (limited and expensive) is AWS.

That's why our in-house solution, combined with our expertise gives us a very cost-effective formula.

[ Parent | on HN ]