News for hackers. Stuff that matters.
Re:Apache Pulsar is an open-source distributed pub-sub messa... by willvarfar on Thursday January 02, 2020 @01:52PM (#21938405)
What's your plan on disaster recovery? Do your workers track their own cursors, and if so, how does that work across regions?
Re:Apache Pulsar is an open-source distributed pub-sub messa... by addisonj on Thursday January 02, 2020 @02:23PM (#21938722)
In Pulsar, offsets are tracked by the service as part of the bookkeeper data (unless you use the reader API which is only really needed for advanced use cases like Flink), that means we just need to do DR for bookkeepers, which I touch on in another response but the tl:dr; is that we have a 3x replication factor as well as EBS snapshots