News for hackers. Stuff that matters.
Re:Pulsar – an open-source distributed pub-sub messaging pla... by samdung on Monday July 13, 2020 @02:13AM (#23817613)
Not yet, but reading the docs. Has 'once only delivery' which is good. Still trying to find if it does FIFO (i think its hard to achieve this in a distributed system).
Re:Pulsar – an open-source distributed pub-sub messaging pla... by jackvanlightly on Monday July 13, 2020 @03:15AM (#23817914)
Yes it does FIFO.

Just like RabbitMQ, Apache Kafka and many other distributed systems, writes go through an elected leader, who is able to ensure ordering guarantees.

Specifically with Apache Pulsar, each topic has an owner broker (leader) who accepts writes and serves readers.

It should be noted that Apache Pulsar supports shared subscriptions which allow two or more consumers to compete for the same messages, like having two consumers on a RabbitMQ queue. Here FIFO order cannot be guaranteed for all kinds of reasons.

Re:Pulsar – an open-source distributed pub-sub messaging pla... by SuddsMcDuff on Monday July 13, 2020 @08:15AM (#23819909)
Re:Pulsar – an open-source distributed pub-sub messaging pla... by dikei on Monday July 13, 2020 @03:46AM (#23818169)
https://pulsar.apache.org/docs/en/concepts-messaging/#orderi...

Basically, they have the same ordering guarantee as Kafka: FIFO is guaranteed for messages from the same producer, within the same partition. If you need producer-level FIFO, then you can only use 1 partition.

There's no ordering guarantee for messages coming from different producer.

Re:Pulsar – an open-source distributed pub-sub messaging pla... by eis on Monday July 13, 2020 @04:28AM (#23818479)
To add:

In a distributed system, an ordering guarantee by producer (and optionally partition "key" which in the end is like an extension of the topic key) is pretty much all you need and all you can get.

If you have two producers then how would one decide which one sent the message first? Go by some timestamp? Clocks are unreliable for these purposes so it comes down to consesus. And letting the queue decide which one came first is equivalent. Once a message got acknowledged by the queue, ordering cannot change anymore.

Re:Pulsar – an open-source distributed pub-sub messaging pla... by oweiler on Monday July 13, 2020 @03:13AM (#23817898)
What do you mean by FIFO? Messages delivered in insertion order? With Kafka, this is easy: messages with the same key land in the same partition. I guess Pulsar offers something similar.