News for hackers. Stuff that matters.

A comment on Kuvasz-streamer: open-source CDC for Postgres for low latency replication.

Re:Kuvasz-streamer: open-source CDC for Postgres for low lat... by dewey on Friday January 03, 2025 @08:51AM (#42585632)
I’ve recently looked into tools like that, I have a busy Postgres table that has a lot of updates on one column and it’s overwhelming Debezium.

I’ve tried many things and looked into excluding them from replication with a publication filter but this still causes “events”.

Anyone has some pointers on CDC on busy tables?

[ Parent | on HN ]
Re:Kuvasz-streamer: open-source CDC for Postgres for low lat... by hundredwatt on Friday January 03, 2025 @04:02PM (#42589436)
That’s one of the cases where query-based CDC may out perform log-based (as long as you don’t care to see every intermediate change that happened to a row between syncs)
[ Parent | on HN ]
Re:Kuvasz-streamer: open-source CDC for Postgres for low lat... by kuvasz-io on Tuesday January 07, 2025 @03:56PM (#42627357)
kuvasz-streamer batches updates in a single timed transaction (1 second for example). This is independent of the source transaction.

I have seen a significant increase in performance with this feature.

[ Parent | on HN ]