News for hackers. Stuff that matters.
Re:We built a new powerful JSON data type for ClickHouse by oulipo on Tuesday October 22, 2024 @01:10PM (#41916384)
would you recommend clickhouse over duckdb? and why?
Re:We built a new powerful JSON data type for ClickHouse by PeterCorless on Tuesday October 22, 2024 @01:52PM (#41916824)
Note that every use case is different and YMMV.

https://www.vantage.sh/blog/clickhouse-local-vs-duckdb

Re:We built a new powerful JSON data type for ClickHouse by hn1986 on Tuesday October 22, 2024 @03:17PM (#41917673)
Great link . Curious how it compares now that Duckdb is 1.0+
Re:We built a new powerful JSON data type for ClickHouse by nasretdinov on Tuesday October 22, 2024 @02:51PM (#41917416)
IMO the only reason to not use ClickHouse is when you either have "small" amount of data or "small" servers (<100 Gb of data, servers with <64 Gb of RAM). Otherwise ClickHouse is a better solution since it's a standalone DB that supports replication and in general has very very robust cluster support, easily scaling to hundreds of nodes.

Typically when you discover the need for OLAP DB is when you reach that scale, so I'm personally not sure what the real use case for DuckDB is to be completely honest.

Re:We built a new powerful JSON data type for ClickHouse by geysersam on Tuesday October 22, 2024 @03:29PM (#41917802)
DuckDB probably performs better per core than clickhouse does for most queries. So as long as your workload fits on a single machine (it's likely that it does) it's often the most performant option.

Besides, it's so simple, just a single executable.

Of course if you're at a scale where you need a cluster it's not an option anymore.

Re:We built a new powerful JSON data type for ClickHouse by zX41ZdbW on Tuesday October 22, 2024 @04:26PM (#41918358)
The good parts of DuckDB that you've mentioned, including the fact that it is a single-executable, are modeled after ClickHouse.
Re:We built a new powerful JSON data type for ClickHouse by RyanHamilton on Tuesday October 22, 2024 @05:41PM (#41919029)
Can you provide a reference for that belief? To me that's not true. They started from solving very different problems.
Re:We built a new powerful JSON data type for ClickHouse by geysersam on Wednesday October 23, 2024 @08:18AM (#41924225)
I didn't express myself well. What I meant to say was that Duckdb runs a single process. That simplifies things.

Clickhouse typically runs several processes (server, clients) interacting and that already makes things more complicated (and more powerful!).

That's not to say one is good and the other bad, they're just quite different tools.

Re:We built a new powerful JSON data type for ClickHouse by justCHurious on Wednesday October 23, 2024 @03:45AM (#41922767)
There is another place where you should not use CH, and it's in a system with shared resources. CH loves, and earned the right, to have spikes of hogging resources. They even allude to this on the Keeper setup - if you put the nodes for the two systems in the same machine, CH will inevitably push Keeper off the bed and the two will come to a disagreement. You should not have it on a k8s Pod for that reason, for example. But then again, you shouldn't have ANY storage of that capacity in a k8s pod anyways.
Re:We built a new powerful JSON data type for ClickHouse by theLiminator on Tuesday October 22, 2024 @01:52PM (#41916826)
Not to mention polars, datafusion, etc. Single node OLAP space is really heating up.
Re:We built a new powerful JSON data type for ClickHouse by fiddlerwoaroof on Tuesday October 22, 2024 @02:08PM (#41916975)
Clickhouse scales from a local tool like Duckdb to a database cluster that can back your reporting applications and other OLAP applications.