Re:Kuvasz-streamer: open-source CDC for Postgres for low lat...
by jitl on Friday January 03, 2025 @11:49AM
(#42587194)
I looked at sequin just now and wish they published their benchmark code. I’m curious how they configure Debezium. At 500 change/s, I get ~90ms average latency with my Debezium cluster after fiddling with Debezium options a bunch.
I don’t love Debezium but I also don’t love Erlang, plenty of us have scars from RabbitMQ’s weird sharp edges…
Re:Kuvasz-streamer: open-source CDC for Postgres for low lat...
by _acco on Friday January 03, 2025 @03:53PM
(#42589363)
Sequin engineer here. We'll publish our benchmark repo soon! Indeed, we're still doing a lot of fiddling with Debezium ourselves to make sure we cover different configurations, deployments, etc.
The main thing we want to communicate is that we're able to keep up with workloads Debezium can handle.
(And, re: RabbitMQ, I wouldn't write off a platform based on a single application built on that platform :) )
Re:Kuvasz-streamer: open-source CDC for Postgres for low lat...
by __s on Friday January 03, 2025 @12:08PM
(#42587380)
You can get single digit latency with almost anything for CDC to queue if you properly colocate your services & your CDC ingestion is keeping up with postgres slot
Re:Kuvasz-streamer: open-source CDC for Postgres for low lat...
by davidarenas on Friday January 03, 2025 @12:19PM
(#42587505)
Should have specified; this is for tracking bursts of up to 1.5k tps not in the same AZ or even VPC.
Currently evaluating https://sequinstream.com/ which claims sub-200ms latency, but has a lot of extras that I don’t need and a lighter weight alternative would be nice.