To be honest this is the least of our problems. We can reboot parts of our cluster without affecting overall capacity much. You just chuck the machines out of the load balancer pool and reboot them.

The issue is versions being pinned on LTS packages to broken versions. This includes svn, MySQL and a notable gcc problem which is a PITA.