News for hackers. Stuff that matters.
Re:Pulsar vs. Kafka by jmchuster on Friday July 10, 2020 @04:59AM (#23789517)
If you are worried about operational complexity and don't know enough to get a clear set of requirement and tradeoffs beforehand, just start off with a single rabbitmq node. By the time you outgrow it, you'll have hired someone who'll be able to make the call for you.
Re:Pulsar vs. Kafka by cmorgan31 on Friday July 10, 2020 @10:34AM (#23791833)
This is likely the best advice in practice as the complexity kafka introduces really only becomes apparent at scale. We ran managed services for our primary production in the 50k+ RPS range that needed a constant stream of tweaking. On the other hand, the isolated EU cluster was self hosted and ran without incident or intervention for 18 months at 1-3k RPS.