News for hackers. Stuff that matters.

logicalstack

Re:DNS Infrastructure at GitHub on Wednesday May 31, 2017 @07:01PM (#14456618)
Full access (read and write) to the PowerDNS HTTP API requires one of their generic SQL backends (via https://docs.powerdns.com/md/httpapi/README/), such as MySQL. The bind backend only supports reading from the API, changes to zones would need to be done on the file system and/or using pdns_control. Beyond that having all our records queryable via SQL has been nice for debugging and researching our own DNS records, types and etc. Lastly, backends like the MySQL one allow for things like auto generating serials and adding comments to the DNS data.
Re:DNS Infrastructure at GitHub on Wednesday May 31, 2017 @04:23PM (#14455599)
Yes, we still use local caches on each host.
Re:DNS Infrastructure at GitHub on Wednesday May 31, 2017 @03:50PM (#14455361)
Nearly all of our internal zones are internal and not sync'd to an external provider. In a few cases we need to perform lookups of internal zones external to our network and those zones live both internal and external.
Re:DNS Infrastructure at GitHub on Wednesday May 31, 2017 @02:26PM (#14454791)
We use the mysql backend and http API, a few small nits but for our purposes it has worked very well thus far. Note that our authorities never see production traffic outside of AXFRs from our "edge" hosts so I can't say how well it works for other use cases.
Re:DNS Infrastructure at GitHub on Wednesday May 31, 2017 @02:01PM (#14454575)
This was a roughly six month project for a single engineer working around 75% of the time on it, with help from other folks along the way for code reviews and etc. The first three months was research, planning, implementation, etc and the latter three months was a very careful roll out and migration from the old system to the new and finally decommissioning the old system.
Re:The GitHub Load Balancer on Thursday September 22, 2016 @11:42PM (#12562169)
We use Quagga.
Re:The GitHub Load Balancer on Thursday September 22, 2016 @04:22PM (#12560033)
CARP and similar systems require an active/passive configuration which we did not want since it needs at least twice as many hosts, half of which are not doing any work. We had similar issues with our former Git storage system based on DRDB (http://githubengineering.com/introducing-dgit/).

pfsync, lvs and etc uses multicast to share connection state which we also wanted to avoid.

Re:The GitHub Load Balancer on Thursday September 22, 2016 @03:34PM (#12559610)
Joe from GitHub here, frankly there is a lot we want to talk about and release and it was simply too much for one post. We'd like to give it a proper treatment and single very long post won't do that. Also, it allows us to get folks interested in the project and give us time to prepare our code for release. It's a surprisingly big job.
Re:The GitHub Load Balancer on Thursday September 22, 2016 @03:27PM (#12559536)
Joe from GitHub here, we'll talk about it later posts but GLB is based on a number of open source projects including, haproxy, iptables, FoU and pf_ring.

Many existing open source solutions are optimized for short lived HTTP requests and don't address the long running connection issue (like a large git clone). We wanted something better for our use case.

Re:How Boundary does application deployments. on Tuesday November 01, 2011 @07:14PM (#3184590)
IIRC the Boundary app cookbook is a pretty big divergence from the Opscode application cookbook due to their reliance on roles, environments and etc. Additionally our cookbook has a far more narrow (I think in a good way) focus. Both have their place, just probably not in the same cookbook.

Older »