News for hackers. Stuff that matters.
Re:Apache Kafka Goes 1.0 by lmsp on Wednesday November 01, 2017 @09:07PM (#15607012)
I think it is beyond partition rebalancing. There is a fact that people didn't realize of making message broker `stateless`. It is actually much better on reacting to failures or shifting traffic, which is critical when running a messaging bus for online services. because it doesn't have to wait for copying the data of a whole partition when error occurs.
Re:Apache Kafka Goes 1.0 by manigandham on Wednesday November 01, 2017 @11:04PM (#15607515)
Agreed, the architecture page and other blog posts do a more thorough job of explaining the details. Having a stateless broker layer on top of a focused data layer makes all the operations much easier. I expect BookKeeper to further integrate with the various cloud storage APIs so it can also start to become stateless cache.