News for hackers. Stuff that matters.
Re:Kafka Is Dead, Long Live Kafka by jitl on Monday August 07, 2023 @09:11PM (#37043185)
> ZooKeeper is rock solid

lol. lmao. never falls over or causes incidents, in the same way c is rock solid and never SIGSEGV or causes security problems

Re:Kafka Is Dead, Long Live Kafka by mdaniel on Monday August 07, 2023 @10:27PM (#37043733)
Some people say "well, it could be worse" but my go-to version is "at least it's not fucking etcd"
Re:Kafka Is Dead, Long Live Kafka by reissbaker on Monday August 07, 2023 @10:43PM (#37043857)
This thread is an excellent example of the author's point: Kafka is polarizing.

Personally, in my experience with Kafka and Zookeeper at Airbnb back in the day (we also used ZK for general-purpose service discovery), they both were... temperamental. They'd chug along just fine for a bit, seemingly handling outages that e.g. RDS would have thrown a fit over, and then suddenly they'd be cataclysmically down in extremely complicated ways and be very difficult to bring back up. Even just using them required teaching a more complex mental model than most cloud-hosted offerings of similar things, and you ended up in this path dependency trap of "we already invested so much in Kafka, so if you want to send a message, use Kafka" when for like 95+% of use cases something easy like SQS would've been fine and simpler. TBQH I don't think either Kafka or ZK ever quite paid back their operational overhead cost, and personally I wouldn't recommend using either unless you absolutely need to.

Warpstream looks really cool in that light!

Re:Kafka Is Dead, Long Live Kafka by EdwardDiego on Monday August 07, 2023 @11:32PM (#37044196)
Fair, that's just been in my experience. It's still better than KRaft though.