Note that difficulty adjustment happens every 2016 blocks. If the miners all decide to call it quits shortly after the previous difficulty change, the next 2016 blocks might take far longer than 10 minutes per block.

Which of course means the next difficulty adjustment would take far longer than two weeks to trigger.