News for hackers. Stuff that matters.
Re:Twitter open-sources a high-performance replicated log se... by asimuvPR on Tuesday May 10, 2016 @02:00PM (#11669190)
Mind sharing a bit more?
Re:Twitter open-sources a high-performance replicated log se... by ryanobjc on Tuesday May 10, 2016 @03:51PM (#11670088)
The classic problem of ZooKeeper is the client and the server upon initial startup will DNS resolve and permanently cache the IP addresses of the ZK cluster. Thus any cluster migrations require you to restart _EVERYTHING_.

So running zookeeper in a dynamic environment becomes very risky. Aka AWS. Perhaps on GCE it's less dangerous, because the host migration is pretty good.

There are other operational issues people have noted above as well.

Re:Twitter open-sources a high-performance replicated log se... by rad_gruchalski on Tuesday May 10, 2016 @04:54PM (#11670574)
Then configure it using IP addresses. I've been using Zookeeper like this for 4 years in public EC2, swapping machines in and out and it always worked. What's the problem.
Re:Twitter open-sources a high-performance replicated log se... by sciurus on Tuesday May 10, 2016 @09:35PM (#11672046)
How is this an improvement over using DNS? When you swap in a new EC2 instance it has different IP addresses from the old instance. So now not only do you have to restart your other Zookeeper servers in the cluster, you have to update their configuration then restart them.
Re:Twitter open-sources a high-performance replicated log se... by curun1r on Wednesday May 11, 2016 @12:46PM (#11676908)
He's probably using ENIs to decouple the IP address from the instance.
Re:Twitter open-sources a high-performance replicated log se... by ryanobjc on Tuesday May 10, 2016 @05:52PM (#11670971)
i think you do know the problem, which is not everyone has that set up. Yes, if you are cloud, and can roll with static IPs then great for you. Some people still have to be on-prem and reusing IPs isn't always an option.
Re:Twitter open-sources a high-performance replicated log se... by ttwwmm on Sunday May 15, 2016 @03:01PM (#11702230)
We run ZooKeeper (and Kafka) within Docker containers and were able to solve this problem with a patch to the client: https://issues.apache.org/jira/browse/ZOOKEEPER-2184

You also need to disable the JVM's insane DNS-caching behavior (config change only).

Re:Twitter open-sources a high-performance replicated log se... by neeleshs on Tuesday May 10, 2016 @10:01PM (#11672150)
Re:Twitter open-sources a high-performance replicated log se... by eropple on Tuesday May 10, 2016 @04:51PM (#11670552)
You're right in that Zookeeper can be a hassle in a dynamic environment, but in my experience Exhibitor largely removes that concern.
Re:Twitter open-sources a high-performance replicated log se... by neilc on Wednesday May 11, 2016 @04:46AM (#11673600)
This behavior should be fixed in Zk 3.4.7+ and 3.5.0+