Re:From Kafka to ZeroMQ for real-time log aggregation
by gerakinis on Saturday September 17, 2016 @02:17PM
(#12521669)
You can turn off multicast discovery and write in unicast peering addresses. If you are in the cloud and you are clustering this is step 1 =)
Re:From Kafka to ZeroMQ for real-time log aggregation
by trimbo on Saturday September 17, 2016 @11:09AM
(#12520781)
> cluster failing with some network issues we had with Rackspace
Were you using Zen Discovery at the time?
I haven't kept up with ES development in the last year so maybe they fixed this, but a flaky network can cause a cluster using Zen to freak out a lot.
BTW I didn't mean to denigrate Elastic Search (I assume that is why I'm getting downvoted.... a comment would help). We just haven't had the chance to upgrade it and properly configure it.
In fact Elastic has been pretty darn speedy as of lately particularly since we purge some of the data after 6 months (we still have permanent filesystem storage of logs of course).