A 4" or 6" hole won't be a problem. In fact, if you go to any commercial project you will probably find more than a few holes that shouldn't have been drilled because there was an over eager mechanical employee or someone who could not read plans properly. Those holes are often just covered up.