News for hackers. Stuff that matters.
Re:From Kafka to ZeroMQ for real-time log aggregation by agentgt on Saturday September 17, 2016 @10:29AM (#12520613)
I'm embarrassed to say that at the present moment we currently don't use ES clustering but rather a monstrous powerful bare metal machine as we had issues with the cluster failing with some network issues we had with Rackspace.

BTW I didn't mean to denigrate Elastic Search (I assume that is why I'm getting downvoted.... a comment would help). We just haven't had the chance to upgrade it and properly configure it.

In fact Elastic has been pretty darn speedy as of lately particularly since we purge some of the data after 6 months (we still have permanent filesystem storage of logs of course).

Re:From Kafka to ZeroMQ for real-time log aggregation by gerakinis on Saturday September 17, 2016 @02:17PM (#12521669)
You can turn off multicast discovery and write in unicast peering addresses. If you are in the cloud and you are clustering this is step 1 =)
Re:From Kafka to ZeroMQ for real-time log aggregation by trimbo on Saturday September 17, 2016 @11:09AM (#12520781)
> cluster failing with some network issues we had with Rackspace

Were you using Zen Discovery at the time?

I haven't kept up with ES development in the last year so maybe they fixed this, but a flaky network can cause a cluster using Zen to freak out a lot.