The troubling thing about the Fermi paradox is that the Great Filter may still be ahead of us.

As in, the universe may be littered with the ruins of single-planet civilizations slightly ahead of our technology level. We may have observed and cataloged many such planets, failing to notice the ruins.