> Others dropping out increases your total income because you get to mine at low difficulty for longer

But not if they only drop out when the difficulty swings high and rejoin when it swings low.