Ask HN: Where to Store Logs?

Re:Ask HN: Where to Store Logs? by codegeek on Saturday October 21, 2023 @02:12PM (#37969192)

Don't insert the logs/events/analytics into your Application DB. Usually, you send those to specialist datastores (OLAP etc) that process such high volume of data. This way, you keep the load and storage on your App db low AND if the analytics data is not working, it doesn't impact your Core Application.

You can use something like clickhouse [0] for example or use 3rd party SAAS solutions like posthog [1] etc that are built on top of clickhouse

[0] https://clickhouse.com

[1] https://posthog.com

[ Parent | on HN ]

Re:Ask HN: Where to Store Logs? by HigherConscious on Saturday October 21, 2023 @03:20PM (#37969746)

I'll have to look into Clickhouse, thanks.

What are the main alternatives to Clickhouse, and how do they fare?

[ Parent | on HN ]

Re:Ask HN: Where to Store Logs? by joshxyz on Sunday October 22, 2023 @12:29AM (#37972829)

https://benchmark.clickhouse.com/

[ Parent | on HN ]

Re:Ask HN: Where to Store Logs? by maxisaurus on Monday October 23, 2023 @04:38AM (#37983038)

Would 100% recommend Posthog, it's open-source and a great product. "Classic" events (like pageviews) are tracked and out-of-box dashboards with cohorts, DAU/MAU charts ready to be used & shared.

Used it in my former company and been using it ever since (not affiliated in anyway with them btw)

[ Parent | on HN ]