News for hackers. Stuff that matters.
Re:An introduction to ZeroMQ by Maro on Wednesday June 23, 2010 @12:39PM (#1455411)
Good read, but the ending is uninformed:

Lets say you want to create some new sort of database because Redis, Cassandra, TokyoTyrant, Postgres, MongoDB, DabbleDB, CouchDB, HBase, etc. just don’t serve your needs that well. You create an amazing in memory tree representation for your data and have a blazing fast indexer. Now all you need is some sort of messaging layer such that different clients can talk to your server. Preferably implemented in different programming language and with clustering capabilities. You could of course create such a messaging framework all by yourself, but that is a lot of hard work.

A simple solution is to just implement your database as a ZeroMQ server and pick a message protocol (fe JSON). As you have seen by now, implementing such functionality with ZeroMQ is really easy and on top of this you will get almost instant scalability because of the way ZeroMQ can route messages.

Interesting scalability and replication problems are not solved by (this kind of) routing. Putting it another way, problems that are solved at this level are also solved by running a bunch of Memcache servers where the standard client already includes a kind of sharding logic.

Re:An introduction to ZeroMQ by shykes on Wednesday June 23, 2010 @06:53AM (#1454596)
ZeroMQ works very well in combination with Apache Zookeeper [1] for service discovery and coordination.

Zookeeper is often overlooked because of the general aura of bloat surrounding Hadoop. It's actually quite lean, and now has python bindings, courtesy of Cloudera.

[1] http://hadoop.apache.org/zookeeper

Re:An introduction to ZeroMQ by DavidMcLaughlin on Wednesday June 23, 2010 @07:39AM (#1454646)
Why do you need both ZeroMQ and Apache Zookeeper for service discovery and coordination? Why not just Zookeeper?
Re:An introduction to ZeroMQ by mmelin on Wednesday June 23, 2010 @07:55AM (#1454673)
I think he meant Zookeeper for discovery & coordination of services using ZeroMQ.
Re:An introduction to ZeroMQ by bsaunder on Wednesday June 23, 2010 @05:13PM (#1456365)
Some things in there seem to be contradictory. In particular, there's a claim about being brokerless:

ZeroMQ follows a brokerless design so that there is no single point of failure.

But then there's this: ZeroMQ greatly simplifies this pattern by allowing you to have a single socket connect to multiple end points.

How does that work? Seems like a cognitive disconnect to me. AFAIK, a single socket can only connect at exactly two end-points (one being a client, the other being a server). Right? Sounds like a broker would be connecting that one socket up to multiple end points...

Maybe there's no CENTRAL broker, but certainly (at least in some configurations and uses), it sounds like there's an intermediary process involved in the communication.

Re:An introduction to ZeroMQ by sustrik on Friday June 25, 2010 @03:17PM (#1461797)
That's the point. Single 0MQ socket is able to communicate with multiple peers.
Re:An introduction to ZeroMQ by nailer on Wednesday June 23, 2010 @07:58AM (#1454680)
Anyone know if 0MQ (or similar) can have multiple publishers send to the same queue? Some context:

- I currently have an app where users submit content to a single machine, which is then queued (using Python's inbuilt Queue object), and processed and displayed by threads that run on the queue.

- In future, I've been thinking about using a network queue to easily publish from a single source to multiple display servers, with a load balancer in between them. This neatly handles my 'view only' users.

- But what about if I wanted to allow users to submit from any server, ie, spreading the load for contributing users as well?

I'm guess I'm looking for a multiple publisher / multiple subscriber queue. Does anyone know if they exist?

Re:An introduction to ZeroMQ by nichol4s on Wednesday June 23, 2010 @08:03AM (#1454692)
Yes, this is commonly called a message bus.

ZeroMQ supports this, you can just use a forwarding device where on one end you can connect the publishers and on the other end the subscribers.

Re:An introduction to ZeroMQ by nailer on Wednesday June 23, 2010 @08:25AM (#1454725)
Thanks Nicholas - I'd heard that term before but not known was it was till now. How do people avoid the forwarding device becoming an SPOF?
Re:An introduction to ZeroMQ by yarapavan on Wednesday June 23, 2010 @08:54AM (#1454767)
From the article: ZeroMQ follows a brokerless design so that there is no single point of failure.
Re:An introduction to ZeroMQ by sustrik on Wednesday June 23, 2010 @10:58AM (#1455079)
There's no SPOF unless you create one. So the sentence should be more correct this way "ZeroMQ follows a brokerless design so that doesn't enforce single point of failure."
Re:An introduction to ZeroMQ by niktech on Wednesday June 23, 2010 @06:57AM (#1454599)
Very interesting. Eagerly waiting for Node.js bindings.
Re:An introduction to ZeroMQ by riklomas on Wednesday June 23, 2010 @09:24AM (#1454833)
Might not be 100% relevant but there's a Node Redis client and Redis can now do publish and subscribe, check out the examples here:

http://github.com/fictorial/redis-node-client/tree/master/ex...

Re:An introduction to ZeroMQ by fictorial on Wednesday June 23, 2010 @12:13PM (#1455316)
Also not relevant to the topic but to this comment is the idea of scaling redis pubsub out horizontally with node.js based clients. This is my NodeRed project.
Re:An introduction to ZeroMQ by bnoordhuis on Wednesday June 23, 2010 @08:35AM (#1454740)
Can't vouch for it but someone already did some work on this.

http://github.com/jmtulloss/zeromq.node

Re:An introduction to ZeroMQ by campnic on Wednesday June 23, 2010 @09:42AM (#1454870)
Great, had been meaning to take a look at ZeroMQ and this was a good 20min read/synopsis. Thanks.
Re:An introduction to ZeroMQ by robinduckett on Wednesday June 23, 2010 @06:45AM (#1454586)
I stopped reading this article because he misspelt "once" as "ones".
Re:An introduction to ZeroMQ by bmelton on Wednesday June 23, 2010 @08:02AM (#1454688)
I downmodded your comment because you misspelled misspelled as misspelt.

I didn't actually, but c'mon.

Re:An introduction to ZeroMQ by bockris on Wednesday June 23, 2010 @08:32AM (#1454734)
OT: I saw a thread on Reddit or Slashdot that featured this chain of replies.

  >>Grammer tip: 'Effect' is used as a noun. 'Affect' is used as a verb.
  >Spelling Tip: Its "Grammar"
  Punctuation Tip: It's "It's".
Re:An introduction to ZeroMQ by anamax on Wednesday June 23, 2010 @12:42PM (#1455421)
Isn't the final "." supposed to be inside the quotes?

IIRC, that's one of the rules that I intentionally break. IMHO, the stuff inside quotes should have whatever punctuation it needs and there should be sentence-appropriate punctuation outside the quotes as well.

Re:An introduction to ZeroMQ by maw on Wednesday June 23, 2010 @01:45PM (#1455580)
It varies from country to country. And from style guide to style guide.

Also, just for what it's worth, affect and effect can both be both nouns and verbs.

Re:An introduction to ZeroMQ by bmelton on Wednesday June 23, 2010 @10:37PM (#1457148)
The one I try to pay attention to is when you're quoting, and continue afterwards.

"He said that he was finished," he stated. (For example) -- but only because I can't think of a more appropriate use of punctuation there, really.

Re:An introduction to ZeroMQ by steveklabnik on Wednesday June 23, 2010 @10:24AM (#1454996)
Isn't 'spelt' just the British spelling of "spelled?"

Would that mean that 'misspelt' is misspelled, does that turn the word irregular?

Re:An introduction to ZeroMQ by robinduckett on Thursday July 01, 2010 @01:08PM (#1478572)
Don't know why you got downboated, considering you're correct, and that guy isn't.