I regularly hear "what if the stock market goes down 80%?" Then I'm totally screwed anyway, whether I'm in the market or not, because everything else will collapse as well.

So there's no point in worrying about such scenarios.