The adjustment algorithm still requires blocks to be generated before it adjusts. If enough miners shut down at the same time, time between blocks will skyrocket, pushing the difficulty adjustment forward even further and crippling the transaction throughput.