News for hackers. Stuff that matters.
Re:Comparing ClickHouse to PostgreSQL and TimescaleDB for ti... by darthShadow on Thursday October 21, 2021 @03:23PM (#28949662)
Does the disk usage go down later once the numerous parts are merged or not?

I would assume it does but reading the article implies that it does not.

Re:Comparing ClickHouse to PostgreSQL and TimescaleDB for ti... by ryanbooz on Thursday October 21, 2021 @04:15PM (#28950277)
Great question. Yes, eventually it does, but (at least for now) it wasn't something we could reliably force as part of the query cycle and know everything was in it's "best" state with ClickHouse. To be honest, we didn't provide the final compressed size of either database because of the need to wait.

The code that's currently used by TSBS was submitted by Altinity, a heavy supporter of ClickHouse in the U.S., but TSBS is open source and anyone is welcome to contribute and make the process/test better!

Re:Comparing ClickHouse to PostgreSQL and TimescaleDB for ti... by darthShadow on Thursday October 21, 2021 @05:02PM (#28950804)
Thanks for the answer.

May be worth pointing that out in the article since the increased disk usage has been mentioned multiple times in the article without any indication that it's only temporary until ClickHouse merges the parts.

Re:Comparing ClickHouse to PostgreSQL and TimescaleDB for ti... by zepearl on Thursday October 21, 2021 @03:35PM (#28949799)
Concerning Clickhouse, yes it does - exactly the same thing e.g. as when you have 2 compressed files containing each 100 sorted rows, when you merge those 200 rows into a single file, sort them and compress them, the result will be smaller than the sum of the 2 separate files.

How much you save is again exactly the same as when dealing directly with files: it depends on the data and on the compression algo.