If you're a tech startup, then I don't even know how you'll be able to do anything without someone technical :-)
I've spoken to some YC founders. You can definitely raise funds without a (real) technical founder.
What do you do with that hardware? Do you go to a colocation and stand the servers up there? Run them from home? What are your options for something like this?
Edit: I realized afterwards you may not be talking about public-facing servers
The key for a small team is finding a colo provider with really good remote hands. Essentially you can setup your rack/cage, leave good instructions and room for expansion. Then you buy a server from dell with financing, ship it to your DC, someone installs an OS and racks it (or you PXE boot from your rack ;) ), then you can provision anything you want. It's essentially like cloud providers but scaling is slower.