Yes, this is commonly called a message bus.
ZeroMQ supports this, you can just use a forwarding device where on one end you can connect the publishers and on the other end the subscribers.
Thanks Nicholas - I'd heard that term before but not known was it was till now. How do people avoid the forwarding device becoming an SPOF?
From the article:
ZeroMQ follows a brokerless design so that there is no single point of failure.
- I currently have an app where users submit content to a single machine, which is then queued (using Python's inbuilt Queue object), and processed and displayed by threads that run on the queue.
- In future, I've been thinking about using a network queue to easily publish from a single source to multiple display servers, with a load balancer in between them. This neatly handles my 'view only' users.
- But what about if I wanted to allow users to submit from any server, ie, spreading the load for contributing users as well?
I'm guess I'm looking for a multiple publisher / multiple subscriber queue. Does anyone know if they exist?