To begin with, the oil is there, stably, at rest. At some point people come along, estimate the layout of the rocks (many km³ and far underground) and drill holes to change the way the pressure works and make as much as possible of the oil flow to a particular location. The geology decides how much that is, modified by the paths of the holes involved, and also by how much water is pumped in, where.
If you now close it quickly, the pressure's going to change somehow and you don't know precisely where and how. The end effect may be that when you reopen, something has changed down there such that instead of extracting 40% of the total oil you can only get 39%. Or such that you have to drill more holes in order to gain back your production velocity, the cost of which is far higher than producing at a loss for a month.
Wait, really? I'm Googling but can't seem to find anything at all about shutting down oil wells temporarily.
What exactly is the difficulty? Why would "turning off the tap" be a risk -- the pressure oil might be under isn't going to go away, is it? (If it doesn't require pumping.) Is it a risk that materials in the drilled hole harden if not moving? I would have thought the difficulty might be how to effectively cap a well that is under pressure -- is it so difficult that closing a well risks damaging the equipment that it can't be safely opened back up?
Really curious here if you have the answers! The fact that oil wells can't be slowed down is definitely one of the most surprising economic facts I've learned in a long time.