News for hackers. Stuff that matters.

mmerli

Re:Open-Sourcing Yahoo's Pulsar, Pub-Sub Messaging at Scale on Tuesday September 13, 2016 @06:33PM (#12492802)
Added some info on geo-replication in Pulsar at https://github.com/yahoo/pulsar/blob/master/docs/GeoReplicat...
Re:Open-Sourcing Yahoo's Pulsar, Pub-Sub Messaging at Scale on Thursday September 08, 2016 @01:52PM (#12455338)
Pulsar dev here. There are certainly many similarities with what Kafka provides, though we made some different choices, especially for the storage layer.

The design has been heavily influenced by these traits: multi-tenancy, millions of topics, strong-durability, geo-replication, low publish latency (even when reading at max IO capacity), maintaining consumer position and, finally, operability (we need to replace machines, shift traffic and increase capacity seamlessly, without any user impact).