EDIT: I will expand on this a bit.
First, the real question you need to know, is, who owns the building your servers will be in? Lots of people claiming to have datacenters are actually renting from someone else, or even sub-leasing from somewhere else, putting you 2 places away from the owner. As much as possible, get into a situation where your monthly payments go directly to the true datacenter owner.
Second, what about the network? Rather than engage in a lot of hand-waving, just find out who they are directly connected to.
Third, do they have both UPS and diesel genset backup for your power? If you are able to physically visit the place, have them show you the physical stuff.
Ignore the "Tier" datacenter and "SAS70" crap, Tier X != reliability and SAS70 is a load of BS (CPAs trying to soak up some consulting dollars - yes, an SAS70 report can only be prepared by a CPA firm...)
Sure, it's an audit compliance document that does nothing of itself to ensure compliance. But: somebody asked and looked at this stuff, and there's absolutely no reason you can't do as much (or little) inspection as you want. Having been on a few DC audits myself, it's an educational process. And still ... onsite redundant generators, fuel, fuel provider contracts, backup batteries, etc., still mean little if there's a fault somewhere in the system (the past few major outages I've experience directly or have read about all included all of the above, but something somewhere failed to cut in or out appropriately).
Nobody's got anything on the Krell though.
Auditors are trained in, like, you know, auditing.
Which is rather more than just beancounting, preconceptions notwithstanding.
And again: what the audit entails is interviews, requesting and reviewing records, and the like. This doesn't guarantee that a SAS70 site is doing what it says it's doing. But if there are gross inconsistencies in the statements and documents, they should stand out.
From there, use the SAS70 report as a basis for your own questions. There are some very good summaries of things to as at sites such as ServerFault, WebHostingTalk, O'Reilly, and elsewhere.
If the SAS70 report says that all access is controlled, but you find you're able to casually stroll through the main door ... something's not adding up. Dig deeper.
That said, the colo should indeed answer all these questions. It's just that most small shops will not be able to make sense of the answers...
If you're a small shop looking to dip a toe into colo then a good summary question to ask is "Who else do you host?". If they have a few big-names to share then they'll probably be good enough for you, too.
Ideally ask for permission to ring up one or two of their reference customers and then actually do that. Colos don't like that very much - but if they outright refuse then you'll know to better look at another one.
But - yes, once you pick up a cabinet, particularly if you are doing any kind of BGP multihoming, pretty much all of those questions need answers (possible exception being their internal procedures - at a certain point you just have to trust them to do their job. )
No, it's fine information, if a bit much. But these questions, for the most part, shouldn't matter until you are big enough for these to be important questions but not for you (presumably a founder).
If you are spending more than, say, two grand a month on co-lo, you probably want different providers for your rack and your bandwidth. Aside from the ease of moving providers to keep costs down, usually the 'house bandwidth' is often 10x market rate. I just got a quote the other day (I only need a little bandwidth, 100Mbps at this new place) and they wanted like $10/Mbps for single homed cogent. $0.50-$1.00/meg is market for single homed Cogent.)
Most of those are reasonable questions, though most salespeople won't know how to answer them. (and many of them, like 'local loop' charges will only make sense to telco guys. In data centers, we call them 'cross connect fees' and they are still important, but much less of a big deal than local loop charges when you are getting a telco line from someone off site)
Note, all of those questions should be asked of the bandwidth provider, not the rack provider. except the cross connect fee - this is what the datacenter/rack provider charges for a connection between you and a transit provider in the building. Sometimes it's one time, but it's usually monthly, and scales directly with how nice the data centre thinks it is. It's $50 one time for copper at he.net, but can be like $300/month+ at a coresite location for fiber.
Note, every bandwidth provider in the building is going to have different answers to all those questions, and even within one provider, the answers will be different based on what class of customer you are or how much you can pay.
Ping - Power - Pipe : Ask everything you need. If a datacenter is unwilling to share or discuss who they are, what they do and what they offer then walk away. Colocation is a buyer beware environment.
Here's a VERY ROUGH list/braindump of questions that AT THE VERY LEAST you need to know before placing equipment with the colocation provider/datacenter.
Tier I,II,III, IV datacenter? Who owns the datacenter? Investors? What's your ASN number(s)? Carrier neutral facility? How many connectivity providers are present in the data center? Does data center run BGP over these providers? IP Transit providers - Bandwidth Pricing? Overage pricing? Straight $mbps/month? Who manages your network? Ip allotment? Assignment procedure? High density for micro vms(Heroku style)? 200 VMs per host meaning 200IPs per vm. Swip/rwhois updates on assignments? Cross-connects? Cross connect pricing? Charges? Local loop(last mile connectivity) charges? BGP support? Is our traffic on a private/separate v-lan from your other customers?
Infrastructure? -Redundancy in detail -Brands -Networking -Connection -Power. Maintenance programs?
A/B feeds from two separator breakers or breaker panels or better yet two Utility Power Service Provider if they are truly A/B feeds. A/B Diesel-Generators? Additional fuel storage on site? Is a PDU included? If so, how many outlets and is it accessible from the web or telnet? What type of hand off/drops to your rack will you be provided (Ethernet)? Are there raised floors? Are there any fire suppression systems in place? Physical/Video Security? Biometrics? Screening of employees?
Insurance requirements to colocate equipment with you?
On-site visit requirements? 24x7 staffing? Remote Hands - Cost and Abilities? What's included? Shipping/Receiving of hardware?
Sas II 70 or SSAE 16 certification? Audit available for review? -Common practices -Staffing -Security -Emergencies - Escalations -Contacts Outage alerts? Notifications through Twitter or similar offsite status page? RFOs for past outages? What's been your corrective action?
Power density per rack? 80% rule or true metered? Can you rack the equipment for us? Who provides cabling? Types of rails for servers? Billing-95th or other? Rack size? Partitioning available? 4u/10u/Quarter/Half? Cages? Lockable or baker's racks? Shared with others?
Finally, ask for a listing of ALL fees.