News for hackers. Stuff that matters.
Re:Robdns – A fast DNS server based on C10M principles by dogma1138 on Saturday December 27, 2014 @11:39AM (#8803026)
TCP/IP is the common name for the Internet Protocol Suite which UDP is part of. Also since many mobile clients tend to issue requests over TCP (due to it being more reliable over mobile), and that many responses can be larger than 512 bytes now and EDNS is not really a standard DNS over TCP will probably over take UDP quite quickly.

The text below is from the RFC, and no it does not relates to zone transfers but to normal DNS queries :)

   All general-purpose DNS implementations MUST support both UDP and TCP
   transport.

   o  Authoritative server implementations MUST support TCP so that they
      do not limit the size of responses to what fits in a single UDP
      packet.

   o  Recursive server (or forwarder) implementations MUST support TCP
      so that they do not prevent large responses from a TCP-capable
      server from reaching its TCP-capable clients.

   o  Stub resolver implementations (e.g., an operating system's DNS
      resolution library) MUST support TCP since to do otherwise would
      limit their interoperability with their own clients and with
      upstream servers.

   Stub resolver implementations MAY omit support for TCP when
   specifically designed for deployment in restricted environments where
   truncation can never occur or where truncated DNS responses are
   acceptable.
And for the most important part :P

   Regarding the choice of when to use UDP or TCP, Section 6.1.3.2 of
   RFC 1123 also says:

      ... a DNS resolver or server that is sending a non-zone-transfer
      query MUST send a UDP query first.

   That requirement is hereby relaxed.  A resolver SHOULD send a UDP
   query first, but MAY elect to send a TCP query instead if it has good
   reason to expect the response would be truncated if it were sent over
   UDP (with or without EDNS0) or for other operational reasons, in
   particular, if it already has an open TCP connection to the server.
Re:Robdns – A fast DNS server based on C10M principles by tptacek on Saturday December 27, 2014 @05:15PM (#8804162)
Why would TCP DNS overtake UDP "quite quickly" when it hasn't done so in the past decade? What's meaningfully changed about DNS recently?
Re:Robdns – A fast DNS server based on C10M principles by jamiesonbecker on Saturday December 27, 2014 @07:33PM (#8804598)
Good call out. Maybe parent is just loosely referring to larger TXT records (or maybe DNSSEC or ipv6?) etc. My guess is that even these are probably a relatively small percentage of overall DNS traffic and that's not likely to change anytime soon.

So I can't imagine why records would all of a sudden exceed 512 bytes on avg either.

Re:Robdns – A fast DNS server based on C10M principles by dogma1138 on Sunday December 28, 2014 @02:17AM (#8805615)
UDP isn't as reliable on mobile connections, many mobile clients issue TCP DNS requests with the UDP request at the same time and not waiting the "casual 5 seconds time out". DNS records also seem to grow and EDNS has not been adopted very well. Other things like Crhome's async DNS prefetch also seem to use TCP as much as UDP for some reason, especially to google DNS servers. The updated RFC mandates TCP support for regular DNS, and although i don't have a single reason (other than IPV6 records, TXT records use and DNSSEC) for why i have a strong feeling that mobile and browser optimizations are a good reason for that. When your browser does DNS pre-fetch from the DOM it becomes much more efficient to open a single TCP connection and issue all of the DNS requests (and with CDN's, adds, capthcas, social media and 3rd party content you can easily get to 20+ distinct DNS records per page) over it rather than issue individual async DNS queries over UDP. This will both be faster and more importantly more reliable for the next step which is the TCP-preconnect once it has resolved all the DNS records from the DOM even before loading it fully.
Re:Robdns – A fast DNS server based on C10M principles by tptacek on Sunday December 28, 2014 @10:19AM (#8806417)
When your browser does DNS pre-fetch from the DOM it becomes much more efficient to open a single TCP connection and issue all of the DNS requests (and with CDN's, adds, capthcas, social media and 3rd party content you can easily get to 20+ distinct DNS records per page) over it rather than issue individual async DNS queries over UDP.

How are there any fewer RTTs with TCP DNS than there would be with UDP? I'm not seeing the efficiency here.

Re:Robdns – A fast DNS server based on C10M principles by JoeAltmaier on Sunday December 28, 2014 @10:22AM (#8806421)
There is a per-packet cost to processing requests. TCP can bundle them; UDP cannot. Is it large enough to matter? I don't know. But the cost includes evaluating context of the requesting entity, which might not be meaningful for DNS queries. Maybe if they are related, some working-set caching would occur.

RTT might not improve at all. But lag might. Scripts often make the mistake of asking for information when they need it. Instead of before they need it, so it will be ready when needed. The suggested approach would pre-load the DNS info and might reduce lag.

Re:Robdns – A fast DNS server based on C10M principles by tptacek on Sunday December 28, 2014 @10:27AM (#8806427)
You're saying that TCP DNS routinely sends multiple requests in a single TCP segment?
Re:Robdns – A fast DNS server based on C10M principles by JoeAltmaier on Sunday December 28, 2014 @10:35AM (#8806439)
TCP sends successive data elements together, at least as part of the Nagle algorithm. I have no idea if the way DNS uses TCP can trigger Nagle.

In fact my own UDP protocol does something similar to Nagle as well. There's no good reason UDP protocols can't pick and choose what features they include. But most don't.

Re:Robdns – A fast DNS server based on C10M principles by tptacek on Sunday December 28, 2014 @10:40AM (#8806449)
I (a) don't think TCP DNS routinely stuffs two requests in a single TCP segment and (b) don't believe TCP DNS is ever more performant than UDP DNS, including on mobile --- UDP gets a head start from not having a 3WH, and doesn't have rate limiting, which TCP does. TCP headers are also much larger than UDP headers.

Even the reliability argument doesn't make sense. Yes, TCP is "reliable". But so is UDP DNS, and in exactly the same way: if a request or response is dropped, it's retransmitted.

Nagle, for what it's worth, is an HN contributor. You could just ask him. :)

Re:Robdns – A fast DNS server based on C10M principles by JoeAltmaier on Sunday December 28, 2014 @10:56AM (#8806489)
Agreed an all counts. Its a stretch to imagine TCP is better at performance.

{edit} though performance isn't really about wire time or packet size - its about cpu time on either end plus buffering. Including router time since that's a cpu in the path.

Re:Robdns – A fast DNS server based on C10M principles by wging on Saturday December 27, 2014 @12:06PM (#8803109)
This is RFC 5966, for those who wondered: http://tools.ietf.org/html/rfc5966