A variation is "never replace/remove something if you can't explain what good it does". The classic example is the big code rewrite, where years of bugfixes and nuances get lost in the 'clean' reimplementation.