There's a recent research project called Farsite which tries to answer these questions.

http://research.microsoft.com/~adya/pubs/osdi2002.pdf