News for hackers. Stuff that matters.
Re:DNS Outage at DigitalOcean by bitJericho on Thursday March 24, 2016 @12:40PM (#11354271)
That's why you use multiple providers.
Re:DNS Outage at DigitalOcean by scurvy on Thursday March 24, 2016 @03:31PM (#11355709)
I'll bite. You can have multiple NS records but only a single SOA. The .com registry minimum TTL for SOA is a day.

How in the world would "multiple providers" help you in a 6 hour outage?

Re:DNS Outage at DigitalOcean by bitJericho on Thursday March 24, 2016 @08:04PM (#11357556)
You can have multiple NS records. You should have ns records that point to different companies DNS servers, and preferably different continents.
Re:DNS Outage at DigitalOcean by scurvy on Thursday March 24, 2016 @10:24PM (#11358113)
That's great for NS records. What about SOA?
Re:DNS Outage at DigitalOcean by bitJericho on Friday March 25, 2016 @12:03AM (#11358423)
Soa isn't used for resolving names afaik.
Re:DNS Outage at DigitalOcean by scurvy on Friday March 25, 2016 @12:33AM (#11358494)
You're right. Sorry I meant the NS glue records. Those have a 1 day minimum TTL. If you're not already running multiple providers, switching after one is down won't help much.
Re:DNS Outage at DigitalOcean by vidarh on Thursday March 24, 2016 @02:10PM (#11355009)
Unless you use a better resolver than the standard glibc resolver on Linux (e.g. dnsmasq, bind or similar running locally and pointing resolv.conf at it), you appear doomed to slow lookups etc. if your first resolv.conf entry fails, as most of the resolv.conf options that might have helped (if you'd set them) simply don't work or doesn't do anything particularly useful in the versions used in the Linux distro's I've tested it on.
Re:DNS Outage at DigitalOcean by pbarnes_1 on Thursday March 24, 2016 @06:25PM (#11356984)
unbound is great for this.
Re:DNS Outage at DigitalOcean by jbaptiste on Thursday March 24, 2016 @01:05PM (#11354479)
Even with multi providers, DNS issues are a cluster fuck.
Re:DNS Outage at DigitalOcean by takeda on Thursday March 24, 2016 @02:21PM (#11355087)
Only if you don't know what you're doing. The problem with DNS is that it might work even when it is misconfigured, and misconfiguration is the source of strange issues.
Re:DNS Outage at DigitalOcean by camikazeg on Thursday March 24, 2016 @03:10PM (#11355507)
I think that we all have areas where we don't know what we're doing. This is one of mine. With all the talk of how obvious/important/easy it is to have a failover in place in case this happens, I'm having trouble finding a good resource about setting up a redundant DNS. Running a droplet on Digital Ocean with Debian and Nginx.
Re:DNS Outage at DigitalOcean by zaroth on Thursday March 24, 2016 @11:21PM (#11358307)
Sounds like we're begging for someone to write a nice blog post for how they set up redundant DNS across multiple providers "the right way"... Sounds like it would hit the front page in short order if anyone is willing to share how they think this should be mitigated, and specifically how to expect common clients to behavior in that case when faced with the various types of outages that may occur!
Re:DNS Outage at DigitalOcean by bitJericho on Thursday March 24, 2016 @01:10PM (#11354530)
Yeah I mean it takes work to do it correctly. I wouldn't call it a cluster fuck.
Re:DNS Outage at DigitalOcean by dsr_ on Thursday March 24, 2016 @12:54PM (#11354380)
Suppose you have multiple providers, but one of them screws up and authoritatively denies the existence of all of your hosts?
Re:DNS Outage at DigitalOcean by bitJericho on Thursday March 24, 2016 @01:09PM (#11354513)
That's what you keep an extremely low ttl for.
Re:DNS Outage at DigitalOcean by Karunamon on Thursday March 24, 2016 @02:04PM (#11354960)
Which doesn't mean much when a nontrivial amount of ISPs out there don't respect the TTL settings.

Source: Days-long service degradation caused by customer ISP's caching bad DNS information well beyond the 10 minute TTL we had set.