News for hackers. Stuff that matters.
Re:RabbitMQ vs. Kafka – An Architect’s Dilemma (Part 1) by raducu on Tuesday September 19, 2023 @05:16PM (#37576824)
> afka is a code smell in a lot of organizations from my experience - most do not need it.

Kafka is really nice if you don't care that much about latency during peak load and you don't have absurd processing times for messages.

Re:RabbitMQ vs. Kafka – An Architect’s Dilemma (Part 1) by ceencee on Tuesday September 19, 2023 @07:39PM (#37578587)
Kafka can sustain sub 20ms at millions or even billions per second scale. Processing time delays is bad consumer code and partition design smell. Aka , your consumer shouldnt depend on a slower resource within an ordering domain. This can also be mitigated with an async consumer
Re:RabbitMQ vs. Kafka – An Architect’s Dilemma (Part 1) by FridgeSeal on Tuesday September 19, 2023 @07:49PM (#37578684)
These sound like consumer issues to me.

Kafka had been extremely reliable with latency, even under load in my experience.

If you’ve got badly lagging consumers that are trying to read from very old points in the topic while everyone else is at the head, you’ll definitely see some increased resource usage, but again, that’s mostly a consumer issue, and I’ve need seen performance degrades that much.

Re:RabbitMQ vs. Kafka – An Architect’s Dilemma (Part 1) by monksy on Tuesday September 19, 2023 @09:10PM (#37579246)
If you're concerned about latency you might want to consider zeromq. Stream processing doesn't really have a time expectation to it.