Kafka without ZooKeeper

Re:Kafka without ZooKeeper by cmckn on Tuesday March 30, 2021 @05:51PM (#26641035)

Correct; but I've seen many uses of Kafka that NATS could totally be used for. For example, load balancing across subscribers (use a NATS queue instead of a Kafka consumer group).

NATS doesn't ever store messages persistently; but this might be fine for your application, and then you don't have to worry about setting 5 different config options to make sure Kafka actually frees up disk space like you expect it to ;)

NATS also enables some unique patterns like request/reply via a "reply to" message header.

Anyway, it's been a joy to use!

[ Parent | on HN ]

Re:Kafka without ZooKeeper by KptMarchewa on Tuesday March 30, 2021 @08:38PM (#26642267)

Sounds more like rabbitmq replacement than kafka

[ Parent | on HN ]

Re:Kafka without ZooKeeper by shaklee3 on Wednesday March 31, 2021 @12:52AM (#26643658)

> NATS doesn't ever store messages persistently

Not true. Both Nats streaming and the upcoming jetstream (core nats) do.

[ Parent | on HN ]

Re:Kafka without ZooKeeper by tsimionescu on Wednesday March 31, 2021 @01:10AM (#26643739)

It depends what you mean by 'persistently'. Normally NATS streaming will delete the messages after they have been delivered to all subscribers successsfully and some expiration time has passed.

[ Parent | on HN ]

Re:Kafka without ZooKeeper by shaklee3 on Wednesday March 31, 2021 @09:38AM (#26647120)

The expiration time can be unlimited, just like kafka

[ Parent | on HN ]

Re:Kafka without ZooKeeper by cmckn on Wednesday March 31, 2021 @02:22PM (#26650992)

I'm aware, I was referring to the core binary, `nats-server`. NATS streaming server seems to be still receiving attention, but the client library (for Java) hasn't been committed to since 2019, so I'm not sure I'd build a new project with it. JetStream is out (as of this week, I believe) and is an optional module to `nats-server`, as you said.

To the folks at Synadia -- I love NATS, but the naming and organization of these projects could use some work. What's with the `stan.*` repository names? Where did "jetstream" come from? Why is it baked into `nats-server` but `nats-streaming-server` isn't? Is `nats-streaming-server` on the back burner?

[ Parent | on HN ]

Re:Kafka without ZooKeeper by shaklee3 on Wednesday March 31, 2021 @02:27PM (#26651059)

Stan is nats streaming. The clients don't have to be updated since they're forward compatible since jetstream. NATS streaming will be deprecated after jetstream is GA is my understanding. Is there a bug in the library you found?

[ Parent | on HN ]

Re:Kafka without ZooKeeper by tamale on Tuesday March 30, 2021 @09:33PM (#26642580)

you also don't have to worry about those kinds of configuration gotchas if you use confluent cloud!

[ Parent | on HN ]

Re:Kafka without ZooKeeper by jimmyed on Tuesday March 30, 2021 @10:15PM (#26642819)

Only you have to be a billionaire to use the confluent cloud.

[ Parent | on HN ]

Re:Kafka without ZooKeeper by incognito_limey on Wednesday March 31, 2021 @04:42AM (#26644880)

So I guess pay as you go is too expensive for your org? Be curious to understand why you feel it's too expensive when it completely extrapolates any kafka management.

[ Parent | on HN ]

Re:Kafka without ZooKeeper by stalller on Wednesday March 31, 2021 @03:45PM (#26652142)

relative to more mature Kafka cloud services, it's crazy expensive.

[ Parent | on HN ]