News for hackers. Stuff that matters.
Re:Is ClickHouse Moving Away from Open Source? by ddorian43 on Sunday September 24, 2023 @04:48AM (#37631261)
StarRocks has compute/storage separation in open-source as example.
Re:Is ClickHouse Moving Away from Open Source? by unamedrus on Monday September 25, 2023 @04:39AM (#37640955)
Not only. Transactions, UPDATES, CBO, Better join optimizations.

It seems that someone is stuck in 2016, when there is no good alternatives for ClickHouse exist in open source.

Re:Is ClickHouse Moving Away from Open Source? by PeterCorless on Monday September 25, 2023 @12:19PM (#37646368)
When datasets are small and can easily fit into a single node [a few terabytes], this isn't as much of an issue. Yet when datasets grow far larger, or when compute/QPS needs grow while the dataset grows slower — when either side of the equation does not scale in balanced proportion with each other — that's when this separation of compute & storage becomes vital. [Either that, or you need to find hardware servers or cloud instance types that also support this imbalance of compute & storage, which is sometimes harder to do; it also locks you into a hardware configuration that cannot dynamically scale as needs and workloads change.]

Apache Pinot also offers the same 2-tier compute/storage separation. And it also has nodes for minion [administrative] tasks. Again, these are more issues for larger scale analytical use cases.

Re:Is ClickHouse Moving Away from Open Source? by ddorian43 on Monday September 25, 2023 @02:24PM (#37648352)
> Apache Pinot also offers the same 2-tier compute/storage separation.

Based on looking at the docs, I don't think so. Maybe only with HDFS. Feel free to link to a page that says otherwise.

Re:Is ClickHouse Moving Away from Open Source? by PeterCorless on Monday September 25, 2023 @03:26PM (#37649246)
The Brokers are the compute layer. The Servers are the storage later.

Note that this is separate from the fact that the Servers can also be in a tiered storage configuration.

https://docs.pinot.apache.org/basics/architecture