Re:Postgres is eating the database world
by benjaminwootton on Friday March 15, 2024 @02:30AM
(#39712608)
There are lots of projects who have managed to achieve this.
Streaming frameworks like Kafka Streams and Flink have incrementally updating tables in memory.
Materialize is built around the concept with a Postgres compatible API.
ClickHouse materialized views act like insert triggers which update when the base table is updated.
Re:Postgres is eating the database world
by pgwhalen on Wednesday March 20, 2024 @03:48PM
(#39771204)
I'm not familiar with ClickHouse materialized views, but the other tech you list (as I roughly understand them) seem more concerned with streaming SQL, which is a related but different end user experience from incrementally refreshed materialized views.
The easy way is to rebuild everything if any “from table” as been modified.
The manual way is to create triggers that perform the minimal updates.