It adjusts every 2016 blocks, but if new miners come online that could in theory be mined in a day instead of two weeks.

I haven't looked too closely at how difficulty adjusted after previous order of magnitude efficiency gains, but the risk is certainly there.