From Kafka to ZeroMQ for real-time log aggregation

Re:From Kafka to ZeroMQ for real-time log aggregation by Nimimi on Saturday September 17, 2016 @02:29AM (#12519418)

You can deploy Kafka using DC/IO and it takes care about HA for you. DC/IO is quickly becoming the go-to solution for database deployments. ArangoDB even recommends it as default.

Now about Kafka vs ZeroMQ: you want Kafka if you cannot tolerate the loss of even a single message. The append-only log with committed reader positions is a perfect fit for that.

[ Parent | on HN ]

Re:From Kafka to ZeroMQ for real-time log aggregation by bogomipz on Saturday September 17, 2016 @04:36AM (#12519696)

>"DC/IO is quickly becoming the go-to solution for database deployments."

It is? Can you provide any evidence supporting this claim?

Mesos is mostly used to deploy stateless services.

[ Parent | on HN ]

Re:From Kafka to ZeroMQ for real-time log aggregation by oblio on Saturday September 17, 2016 @02:35AM (#12519432)

Do you mean this? https://dcos.io/get-started/ aka DC/OS?

From what I can see it doesn't really support database deployments except for ArangoDB and Cassandra.

[ Parent | on HN ]

Re:From Kafka to ZeroMQ for real-time log aggregation by ryanmaclean on Saturday September 17, 2016 @03:54AM (#12519594)

Riak and MySQL are in Universe, for example: https://github.com/mesosphere/universe/tree/version-3.x/repo...

[ Parent | on HN ]

Re:From Kafka to ZeroMQ for real-time log aggregation by Nimimi on Saturday September 17, 2016 @02:52AM (#12519465)

Ok, database was the wrong term. Maybe "things that big data companies use" or something.

[ Parent | on HN ]

Re:From Kafka to ZeroMQ for real-time log aggregation by mej10 on Saturday September 17, 2016 @08:04AM (#12520174)

I wish there was more information on how much work it takes to maintain a DC/OS setup. All the marketing makes it out to be the easiest thing in the world.

[ Parent | on HN ]