News for hackers. Stuff that matters.
Re:Show HN: GraphJSON – Easily log and analyze events using ... by shinzui on Wednesday August 17, 2022 @01:30PM (#32499282)
GraphJSON looks nice. Do you mind sharing the clickhouse infrastructure that's powering it?
Re:Show HN: GraphJSON – Easily log and analyze events using ... by flurly on Wednesday August 17, 2022 @02:32PM (#32499991)
I'm not sure what you mean. ClickHouse is an open source project. You can check it out here https://github.com/ClickHouse/ClickHouse
Re:Show HN: GraphJSON – Easily log and analyze events using ... by linuxdude314 on Wednesday August 17, 2022 @04:26PM (#32501278)
I believe they are referring to how you architected your ClickHouse deployment(s).

Are you cloud based? Using container orchestration?

Is it one cluster per customer? Multi-tenant? Can I use all standard available ClickHouse integrations?

How do you manage scaling?

Its not the easiest system to manage at scale, so getting some insight here would be a good way to help your customers see some competency here!

Re:Show HN: GraphJSON – Easily log and analyze events using ... by flurly on Wednesday August 17, 2022 @05:05PM (#32501739)
Ah I see. Let me answer your questions one by one.

> Are you cloud based? Using container orchestration?

Yes it's all in the cloud. The infrastructure is spun up using terraform and automated using ansible.

> Is it one cluster per customer? Multi-tenant?

Multi tenant with rate limits to ensure one customer doesn't take down the entire cluster.

> Can I use all standard available ClickHouse integrations?

Most of them are enabled by default - for instance window functions are available. If there is one that isn't available, feel free to email me and I'll most likely enable it.

> How do you manage scaling?

Unfortunately ClickHouse doesn't have a notion of consistent hashing, so currently we scale by simply adding more nodes and reindexing the whole table. That being said, Clickhouse is incredibly space efficient, so we haven't had to do this very often.

Re:Show HN: GraphJSON – Easily log and analyze events using ... by shinzui on Thursday August 18, 2022 @12:37AM (#32505346)
Thanks. That's exactly what I meant.
Re:Show HN: GraphJSON – Easily log and analyze events using ... by julienfr112 on Wednesday August 17, 2022 @04:23PM (#32501240)
Infra meaning hardware ?