News for hackers. Stuff that matters.
Re:Postgres is eating the database world by iTokio on Friday March 15, 2024 @02:26AM (#39712591)
Is this feature even possible? How can the database unravel a complex queries with derived data to minimal updates from its normalized parts?

The easy way is to rebuild everything if any “from table” as been modified.

The manual way is to create triggers that perform the minimal updates.

Re:Postgres is eating the database world by benjaminwootton on Friday March 15, 2024 @02:30AM (#39712608)
There are lots of projects who have managed to achieve this.

Streaming frameworks like Kafka Streams and Flink have incrementally updating tables in memory.

Materialize is built around the concept with a Postgres compatible API.

ClickHouse materialized views act like insert triggers which update when the base table is updated.

Re:Postgres is eating the database world by pgwhalen on Wednesday March 20, 2024 @03:48PM (#39771204)
I'm not familiar with ClickHouse materialized views, but the other tech you list (as I roughly understand them) seem more concerned with streaming SQL, which is a related but different end user experience from incrementally refreshed materialized views.
Re:Postgres is eating the database world by shpongled on Friday March 15, 2024 @02:33AM (#39712625)
I believe differential data flow techniques (Materialize, Noria) enable this kind of stuff