News for hackers. Stuff that matters.

A comment on RabbitMQ vs. Kafka – An Architect’s Dilemma (Part 1).

Re:RabbitMQ vs. Kafka – An Architect’s Dilemma (Part 1) by bhouston on Tuesday September 19, 2023 @04:31PM (#37576096)
If you use Confluent Kafka, the billing is pretty high. About 4 years ago it was much cheaper, but then they completely revamped the pricing to something ridiculous. I found that switching to Google Pub/Sub, at least if it meets your needs, is cheaper.
[ Parent | on HN ]
Re:RabbitMQ vs. Kafka – An Architect’s Dilemma (Part 1) by AndyPa32 on Tuesday September 19, 2023 @04:44PM (#37576264)
Yes, I can confirm that. Confluent is the most expensive part of our current infrastructure.
[ Parent | on HN ]
Re:RabbitMQ vs. Kafka – An Architect’s Dilemma (Part 1) by bhouston on Tuesday September 19, 2023 @04:59PM (#37576527)
Can you switch away from it? Or do you need its advanced features?
[ Parent | on HN ]
Re:RabbitMQ vs. Kafka – An Architect’s Dilemma (Part 1) by relay23 on Tuesday September 19, 2023 @09:23PM (#37579336)
Sounds about right.
[ Parent | on HN ]
Re:RabbitMQ vs. Kafka – An Architect’s Dilemma (Part 1) by esafak on Tuesday September 19, 2023 @06:42PM (#37578043)
I see they offer Kafka's exactly-once delivery: https://cloud.google.com/blog/products/data-analytics/cloud-...
[ Parent | on HN ]
Re:RabbitMQ vs. Kafka – An Architect’s Dilemma (Part 1) by relay23 on Tuesday September 19, 2023 @09:23PM (#37579334)
Kafka doesn't guarantee exactly once delivery at all, unless you're using Kafka Streams and even then your final output topic still won't get exactly once, the consumer group protocol doesn't allow for it.
[ Parent | on HN ]
Re:RabbitMQ vs. Kafka – An Architect’s Dilemma (Part 1) by relay23 on Tuesday September 19, 2023 @09:22PM (#37579323)
It's cheaper until you get to a sizeable workload, and the P90+ latency is ridiculous.. the kafka api is weak and when you're not using kafka api you're limited on integration tools unless you want to be super locked in to GCP.
[ Parent | on HN ]
Re:RabbitMQ vs. Kafka – An Architect’s Dilemma (Part 1) by bhouston on Wednesday September 20, 2023 @10:55AM (#37584997)
The lock-in argument is a non starter with me. I never see people move between clouds (well it happens but it is incredibly rare) and it isn’t because of lock in but rather they are pretty close to equivalent. And if you wanted to go on prem you can replace the messaging system, it isn’t one of the hardest steps of going on prem.
[ Parent | on HN ]