Kafka without ZooKeeper

Re:Kafka without ZooKeeper by rad_gruchalski on Tuesday March 30, 2021 @11:30PM (#26643211)

Re 2, have you ever tried using Kafka with a non-JVM client?

[ Parent | on HN ]

Re:Kafka without ZooKeeper by EdwardDiego on Wednesday March 31, 2021 @12:17AM (#26643464)

Yep, I have, no issues with the consumer/producer knowing who the partition leader is.

That said, curious to hear your experiences :)

[ Parent | on HN ]

Re:Kafka without ZooKeeper by rad_gruchalski on Wednesday March 31, 2021 @12:22AM (#26643497)

I don’t have issues per se as long as I stick to librdkafka but even that is constantly playing catch up.

Outside of librdkafka and jvm client, it’s gloves off.

[ Parent | on HN ]

Re:Kafka without ZooKeeper by EdwardDiego on Wednesday March 31, 2021 @01:26AM (#26643821)

Yeah, that's true, using librdkafka from C# I hit a few issues where librdkafka was somewhat behind Java in terms of features, I think the one I hit was multi-topic subscriptions.

IIRC Confluent has started putting resources into it - I would hope so, given how .NET Core is going.

That said, the state of Pulsar clients outside of the official Java ones was far worse, I was looking into .NET Core ones and the "official" one (Pulsar-DotPulsar) lacked some key features, whereas a third party one, pulsar-client-dotnet, had far more features, but was still somewhat behind the Java clients.

Caveat is that I looked into all of this when Pulsar was at version 2.6, it's not at 2.7.1, so my comments may well be out of date.

[ Parent | on HN ]

Re:Kafka without ZooKeeper by mrkeen on Wednesday March 31, 2021 @03:28AM (#26644428)

kafkacat is excellent.

https://github.com/edenhill/kafkacat

[ Parent | on HN ]

Re:Kafka without ZooKeeper by rad_gruchalski on Wednesday March 31, 2021 @05:45AM (#26645255)

Definitely, if all one needs is command line.

[ Parent | on HN ]