Of course it's a bad idea to make unnecessary system changes (install patches) that bring system to essentially unknown state that nobody ever tested (the order and set of patches installed over your specific OS configuration).

You only patch what you need to patch. Most of the time for every production service you end up building a custom version anyway. Patching does no good to those.

So, by patching you only bring potential harm and overhead of going through change control processes.