Well the key is to always do clean-installs and join the fleet and decommission the old machines. Machines are essentially immutable and disposable, so upgrades are done with full machines. And if anything hardware goes bad on whole or sometimes half racks.