If you're using round robin dns, killing the web server will force clients with that particular server cached first to connect to a different one.

Not particularly elegant, but not a complete fail.