Re:We built a new powerful JSON data type for ClickHouse
by geysersam on Tuesday October 22, 2024 @03:29PM
(#41917802)
DuckDB probably performs better per core than clickhouse does for most queries. So as long as your workload fits on a single machine (it's likely that it does) it's often the most performant option.
Besides, it's so simple, just a single executable.
Of course if you're at a scale where you need a cluster it's not an option anymore.
Re:We built a new powerful JSON data type for ClickHouse
by zX41ZdbW on Tuesday October 22, 2024 @04:26PM
(#41918358)
The good parts of DuckDB that you've mentioned, including the fact that it is a single-executable, are modeled after ClickHouse.
Re:We built a new powerful JSON data type for ClickHouse
by RyanHamilton on Tuesday October 22, 2024 @05:41PM
(#41919029)
Can you provide a reference for that belief? To me that's not true. They started from solving very different problems.
Re:We built a new powerful JSON data type for ClickHouse
by geysersam on Wednesday October 23, 2024 @08:18AM
(#41924225)
I didn't express myself well. What I meant to say was that Duckdb runs a single process. That simplifies things.
Clickhouse typically runs several processes (server, clients) interacting and that already makes things more complicated (and more powerful!).
That's not to say one is good and the other bad, they're just quite different tools.
Re:We built a new powerful JSON data type for ClickHouse
by justCHurious on Wednesday October 23, 2024 @03:45AM
(#41922767)
There is another place where you should not use CH, and it's in a system with shared resources. CH loves, and earned the right, to have spikes of hogging resources. They even allude to this on the Keeper setup - if you put the nodes for the two systems in the same machine, CH will inevitably push Keeper off the bed and the two will come to a disagreement. You should not have it on a k8s Pod for that reason, for example. But then again, you shouldn't have ANY storage of that capacity in a k8s pod anyways.
Typically when you discover the need for OLAP DB is when you reach that scale, so I'm personally not sure what the real use case for DuckDB is to be completely honest.