The point is that things are connected. By physically accessing one machine you bring down not just one machine but the entire network. The importance of physical security just went up by a factor of the number of machines on the network.

At some point you are going to have to focus on the network part of security. Getting physical access to one Google server shouldn't allow you to bring down all of Google.