News for hackers. Stuff that matters.
Re:Postgres high-availability cluster with auto-failover and... by jpgvm on Tuesday November 17, 2015 @04:19AM (#10579990)
This is inferior to the Manatee design: https://github.com/joyent/manatee

Funnily enough I ran into this yesterday when Mist was posted and I looked at what other projects were under the umbrella.

Re:Postgres high-availability cluster with auto-failover and... by tylerflint on Tuesday November 17, 2015 @11:33AM (#10582149)
Much of the architecture of yoke was inspired by manatee. In fact, we've spent the last 2 years working with Joyent on smartos and illumos, so we were heavily inspired by the great engineering behind manatee.

Manatee didn't work for our use cases, which should not be interpreted as "manatee is bad". Here are a few of the reasons we forged a different solution:

- While node.js is a great language for many things, we didn't want the overhead of running the node.js/v8 runtime alongside postgres. 50M might seem negligible, but with thousands of postgres clusters for our clients every MB adds up.

- We didn't want the administrative overhead of managing a zookeeper cluster, and instead built the cluster management semantics directly into the yoke project.

- This may be different now, but at the time manatee was very heavily integrated into illumos/smartos. We really love smartos, but recognize that not all clients are able to use this tech.

Re:Postgres high-availability cluster with auto-failover and... by lobster_johnson on Tuesday November 17, 2015 @11:44AM (#10582240)
You guys seem to be creating a bunch of great little tools, but I wish you would spend more time on documentation.

For example, in this case it's not at all clear how the cluster management works, or even what the semantics are.

Re:Postgres high-availability cluster with auto-failover and... by tylerflint on Tuesday November 17, 2015 @12:26PM (#10582594)
I couldn't agree more. We literally just introduced the nanopack cloud-initiative on friday (https://blog.nanobox.io/nanopack-a-new-vision-for-automated-...). Bear with us, we'll get there!
Re:Postgres high-availability cluster with auto-failover and... by dan353hehe on Tuesday November 17, 2015 @08:45AM (#10580933)
True it is, however to use manatee you have to build on ZFS, which unfortunately is not as widely adopted as it should be.
Re:Postgres high-availability cluster with auto-failover and... by jpgvm on Tuesday November 17, 2015 @09:53AM (#10581373)
Aye but ZFS on Linux is rock solid and definitely the way to go.

Technically you don't need ZFS to use the Manatee state machine. You could swap out the ZFS snapshot transfer service to use pg_basebackup instead.

For anyone interested I have made the appropriate alterations to Manatee to get it to run on Ubuntu with the standard ubuntu-zfs packages.

The fork is here: https://github.com/josephglanville/manatee

Chef cookbook to help you get started along with the other dependencies: https://github.com/josephglanville/cookbook-manatee