First thing I thought was that it should include DNS.

We have a Chef plugin that maps all our machines to IPs. We then delegate a short subdomain to that DNS server and bam, access any server at hostname.sub.domain.com

Set it to your search domain and you can access any of your servers with just the hostname.