Kafka is Fast – I'll use Postgres

Re:Kafka is Fast – I'll use Postgres by throwwgisgreat on Thursday October 30, 2025 @12:53PM (#45762166)

> processing billions of Kafka events per day

Except that the burden is on all clients to coordinate to avoid processing an event more than once since Kakfa is a brainless invention just dumping data forever into a serial log.

[ Parent | on HN ]

Re:Kafka is Fast – I'll use Postgres by williamdclt on Thursday October 30, 2025 @01:42PM (#45762797)

I'm not sure what you're talking about.

Do you mean different consumers within the same consumer group? There's no technology out there that will guarantee exactly-once delivery, it's simply impossible in a world where networks aren't magically 100% reliable. SQS, RedPanda, RabbitMQ, NATS... you call it, your client will always need idempotency.

[ Parent | on HN ]

Re:Kafka is Fast – I'll use Postgres by mrkeen on Friday October 31, 2025 @01:10AM (#45768631)

That is called a 'consumer group' which has been a part of Kafka for 15 years.

The author is suggesting to avoid this solution and roll your own instead.

[ Parent | on HN ]