News for hackers. Stuff that matters.
Re:PolyScale and ClickHouse Materialized Views by erikpukinskis on Wednesday August 17, 2022 @11:02AM (#32497347)
I would love to see more databases support something like this. “Live queries” kind of thing.

“Modern” app development today usually presumes some element of “live updates” or “multiplayer” functionality. It’s usually handled only partially, in the app layer, with a good amount of spaghetti.

But the database to me seems like the place where this should happen. I should be able to

    SELECT * FROM projects
    WHERE owner_id=x
    ORDER BY name desc
    LIMIT 20
    OFFSET 60;
and then I should be able to subscribe to any changes to that query.

I should be able to have thousands of these subscriptions open at a time.

And ideally I should be able to get an efficient diff rather than a new result. Although a new result would be a great start.

I’m not sure why this isn’t seen as table stakes for databases in 2022. It seems like such a fundamental challenge of distributed application development.

Re:PolyScale and ClickHouse Materialized Views by iany on Monday August 29, 2022 @05:01AM (#32636093)
RisingWave is another option worth considering. Open source and cloud-native from the get-go: https://www.risingwave.dev/docs/latest/intro/
Re:PolyScale and ClickHouse Materialized Views by hodgesrm on Wednesday August 17, 2022 @11:05AM (#32497377)
ClickHouse has a couple of features along this line: live views and window views. Here's a blog that compares them.

https://altinity.com/blog/battle-of-the-views-clickhouse-win...

Disclaimer: I work for Altinity. Polyscale is a customer.

Re:PolyScale and ClickHouse Materialized Views by benjaminwootton on Wednesday August 17, 2022 @11:27AM (#32497625)
I did a deep dive video on some of the options around Clickhouse materialised views too:

https://m.youtube.com/watch?v=i7VYsf1e2qU

Re:PolyScale and ClickHouse Materialized Views by fasteo on Wednesday August 17, 2022 @11:17AM (#32497515)
Related to this and Polyscale use case. Would this work ?

  CREATE WINDOW VIEW IF NOT EXISTS minute_metrics_wv minute_metrics_tt AS SELECT ... FROM raw_metrics WHERE ... GROUP BY ...
That is, replacing the materialized view if favor of a WINDOW VIEW
Re:PolyScale and ClickHouse Materialized Views by contrahax on Wednesday August 17, 2022 @01:03PM (#32498919)
RethinkDB (RIP) was really big on this concept and we used it for a few applications back in the day. Even since then (~2016) it doesn't seem to have caught on to any other major DBs.
Re:PolyScale and ClickHouse Materialized Views by fasteo on Wednesday August 17, 2022 @11:10AM (#32497429)
Check materialize[1]

[1] https://materialize.com/

Re:PolyScale and ClickHouse Materialized Views by TOMDM on Wednesday August 17, 2022 @11:26AM (#32497612)
Materialize looks like a perfect tool for the job should the need ever arise.

I think my ideal would be for the functionality to be baked directly into PostgreSQL.

Has anyone here used it?

Any comments on speed/scalability/reliability?

The self hosted license seems fairly permissive (Don't cluster, don't let your users manage the database views/queries [IANAL, read the license yourself]), but I'm hesitant given that I have never heard anyones stories about production use.

Re:PolyScale and ClickHouse Materialized Views by iany on Monday August 29, 2022 @04:59AM (#32636084)
> The self hosted license seems fairly permissive (Don't cluster, don't let your users manage the database views/queries [IANAL, read the license yourself])

The self-hosted version is being discontinued after the current version. The only offering will be the purely commercial cloud offering.

Re:PolyScale and ClickHouse Materialized Views by powvans on Wednesday August 17, 2022 @02:13PM (#32499771)