News for hackers. Stuff that matters.
Re:Hydra: Column-Oriented Postgres by hazaskull on Friday August 25, 2023 @02:34AM (#37258774)
They don't optimize for it and I suppose the data distribution is primarily aimed at parallel OLTP rather than OLAP. Just wanted to mention that design-wise it is similar but that's indeed not all there is to it. I'd be hesitant to store large volumes of data on a single PG instance; don't see how a single-writer, filesystem-based database is suitable at all for data that is large enough to warrant columnar storage
Re:Hydra: Column-Oriented Postgres by riku_iki on Friday August 25, 2023 @02:46AM (#37258839)
so, what would be your db choice for OLAP?
Re:Hydra: Column-Oriented Postgres by hazaskull on Friday August 25, 2023 @03:33AM (#37259107)
No expert but I'd say you'd rather be looking at bigquery, Redshift, Clickhouse, Snowflake, etc.
Re:Hydra: Column-Oriented Postgres by esafak on Friday August 25, 2023 @02:01PM (#37264968)
You can also go HTAP with TiDB which has TiKV for OLTP and TiFlash (Raft-based columnar replicas) for OLAP.
Re:Hydra: Column-Oriented Postgres by riku_iki on Friday August 25, 2023 @02:11PM (#37265152)
I am more interested in actual OLAP than HTAP, and don't see strong OSS OLAP offering on the market right now, my rants in previous discussion: https://news.ycombinator.com/item?id=36992039

But I should look at TiDB, they looks like interesting and relatively mature project.

Re:Hydra: Column-Oriented Postgres by esafak on Friday August 25, 2023 @02:19PM (#37265255)
https://www.starrocks.io/ is on my shortlist for OLAP
Re:Hydra: Column-Oriented Postgres by riku_iki on Friday August 25, 2023 @02:59PM (#37265784)
its also on my list, but it looks like not easy to try, setup procedure is complicated.