News for hackers. Stuff that matters.
Re:ClickHouse gets lazier (and faster): Introducing lazy mat... by jurgenkesker on Tuesday April 22, 2025 @01:52PM (#43764667)
I really like Clickhouse. Discovered it recently, and man, it's such a breath of fresh air compared to suboptimal solutions I used for analytics. It's so fast and the CLI is also a joy to work with.
Re:ClickHouse gets lazier (and faster): Introducing lazy mat... by EvanAnderson on Tuesday April 22, 2025 @02:52PM (#43765131)
Same here. I come from a strong Postgres and Microsoft SQL Server background and I was able to get up to speed with it, ingesting real data from text files, in an afternoon. I was really impressed with the docs as well as the performance of the software.
Re:ClickHouse gets lazier (and faster): Introducing lazy mat... by osigurdson on Tuesday April 22, 2025 @08:37PM (#43767615)
Having a SQL like syntax where everything feels like a normal DB helps a lot I think. Of course, it works very differently behind the scenes but not having to learn a bunch of new things just to use a new data model is a good approach.

I get why some create new dialects and languages as that way there is less ambiguity and therefore harder to use incorrectly but I think ClickHouse made the right tradeoffs here.

Re:ClickHouse gets lazier (and faster): Introducing lazy mat... by theLiminator on Tuesday April 22, 2025 @04:35PM (#43766011)
How does it compare to duckdb and/or polars?
Re:ClickHouse gets lazier (and faster): Introducing lazy mat... by thenaturalist on Tuesday April 22, 2025 @06:41PM (#43766982)
This is very much an active space, so the half-life of in depth analyses is limited, but one of the best write ups from about 1.5 years ago is this one: https://bicortex.com/duckdb-vs-clickhouse-performance-compar...
Re:ClickHouse gets lazier (and faster): Introducing lazy mat... by nasretdinov on Wednesday April 23, 2025 @02:50AM (#43769335)
In my understanding DuckDB doesn't have its own optimised storage that can accept writes (in a sense that ClickHouse does, where it's native storage format gives you best performance), and instead relies on e.g. reading data from Parquet and other formats. That makes sense for an embedded analytics engine on top of existing files, but might be a problem if you wanted to use DuckDB e.g. for real-time analytics where the inserted data needs to be available for querying in a few seconds after it's been inserted. ClickHouse was designed for the latter use case, but at a cost of being a full-fledged standalone service by design. There are embedded versions of ClickHouse, but they are much bulkier and generally less ergonomic to use (although that's a personal preference)
Re:ClickHouse gets lazier (and faster): Introducing lazy mat... by theLiminator on Wednesday April 23, 2025 @01:48PM (#43774727)
Nah, duckdb does have their own format (not sure if it's write friendly, though i believe it is).
Re:ClickHouse gets lazier (and faster): Introducing lazy mat... by nasretdinov on Wednesday April 23, 2025 @01:51PM (#43774760)
It does, but the performance isn't great apparently: https://github.com/duckdb/duckdb/discussions/10161
Re:ClickHouse gets lazier (and faster): Introducing lazy mat... by theLiminator on Wednesday April 23, 2025 @05:21PM (#43776740)
Yeah, I don't really know. Though in the OLAP space that issue/discussion is really old. There's a good chance that performance is dramatically better now though YMMV.
Re:ClickHouse gets lazier (and faster): Introducing lazy mat... by thenaturalist on Thursday April 24, 2025 @11:39AM (#43784065)
It cannot do concurrent writes natively and that is not a design goal of the DuckDB creators. See: https://duckdb.org/docs/stable/connect/concurrency.html#writ...
Re:ClickHouse gets lazier (and faster): Introducing lazy mat... by spatular on Thursday April 24, 2025 @11:43AM (#43784115)
Clickhouse is a network server, duckdb and polars are in-process databases. It's like postgres vs sqllite.
Re:ClickHouse gets lazier (and faster): Introducing lazy mat... by theLiminator on Friday April 25, 2025 @12:59PM (#43795989)
There's chdb though.
Re:ClickHouse gets lazier (and faster): Introducing lazy mat... by pests on Tuesday April 22, 2025 @07:03PM (#43767097)
I remember a few years ago when the views on Clickhouse was it some "legacy" "bulky" and used by "the big guys" and not very much discussion or opinions of it in spaces like this. Seems like its come a long way.
Re:ClickHouse gets lazier (and faster): Introducing lazy mat... by ksec on Tuesday April 22, 2025 @09:06PM (#43767742)
Lots of Google analytics competitors appeared between 2017 and 2023 due to privacy reasons. And a lot of them started with normal Postgres or MySQL then switched to Clickhouse or simply started with Clickhouse knowing they could scale far better.

At least in terms of capability and reputation it was already well known by 2021 and certainly not legacy or bulky. At least on HN clickhouse is very often submitted and reached front page. Compared to MySQL when I tried multiple times no one is interested.

Edit: On another note Umami is finally supporting Clickhouse! [1], Not sure how they implementing it because it still requires Postgres. But it should hopefully be a lot more scalable.

[1] https://github.com/umami-software/umami/issues/3227

Re:ClickHouse gets lazier (and faster): Introducing lazy mat... by pests on Tuesday April 22, 2025 @09:24PM (#43767862)
Perhaps not legacy/bulky buy it maybe... enterprisey? I just remember having the same reaction to CH as to hearing Oracle.
Re:ClickHouse gets lazier (and faster): Introducing lazy mat... by ksec on Tuesday April 22, 2025 @09:33PM (#43767913)
Or may be Heavy duty? Although I remember a lot of people were sceptical of CH simply because it came from Yandex from Russia. And that was before the war.
Re:ClickHouse gets lazier (and faster): Introducing lazy mat... by teej on Tuesday April 22, 2025 @09:09PM (#43767765)
Clickhouse earned that reputation. However, it was spun out of Yandex in 2021. That kickstarted a new wave of development and it’s gotten much better.
Re:ClickHouse gets lazier (and faster): Introducing lazy mat... by pests on Tuesday April 22, 2025 @09:25PM (#43767863)
Ah that must explain a lot of it.
Re:ClickHouse gets lazier (and faster): Introducing lazy mat... by shmerl on Tuesday April 22, 2025 @10:53PM (#43768253)
What's the story with the Debian package for it? It was removed as unmaintained.
Re:ClickHouse gets lazier (and faster): Introducing lazy mat... by lukaslalinsky on Wednesday April 23, 2025 @01:46AM (#43768992)
I always dismissed ClickHouse, because it's all super low level. Building a reliable system out of it, requires a lot of internal knowledge. This is the only DB I know, where you will have to deal with actual files on disk, in case of problems.

However, I managed to look besides that, and oh-my-god it is so fast. It's like the tool is optimized for raw speed and whatever you do with it is up for you.

Re:ClickHouse gets lazier (and faster): Introducing lazy mat... by nasretdinov on Wednesday April 23, 2025 @02:38AM (#43769272)
Yeah ClickHouse does feel like adult LEGO to me too: it lets you design your data structures and data storage layout, but doesn't force you to implement everything else. If you work on a large enough scale that's exactly what you want from a system usually