This assumes that there are gazillons of alien civs yet somehow they all come to the same decision. That's much less likely than gazillions of alien civs all make different decisions and it only takes a single one to make the replicating probs or try to colonize.
If there were 50 other Earths scattered around the galaxy (ones that have been broadcasting like us but for longer) should the first television have imnediately picked up interstellar "I Love Lucy" or would it be faint anomalies from SETI? Somewhere in between?
So any SETI signals we might detect would almost certainly need to be intentional. That doesn't mean they would need to be responses to something we've broadcast just the sender was aiming their transmitter towards the solar system and sent a signal.
[0] https://web.archive.org/web/20140719094337/http://www.comput...
With the material explained away, the lack signals is much easier to explain in that we haven't listened long and we can only hear very loud signals. (Or maybe advanced civs don't use light and use gravity waves or tachyon beams or whatever, but you don't even need to go that far.) The only way we hear a signal is if it's:
1. loud (high energy) and aimed directly at us, like a tight beam
2. EXTREMELY LOUD and aimed everywhere, isotropically
1 is unlikely since they'd have to know where we are; 2 is unlikely since you're talking about an insane level of energy. If it's the case that civs don't seem to be making Dyson spheres or harvesting whole galaxies for energy, being able to throw around that kind of power is prohibitively expensive. In both these cases, the inverse square law applies (for every unit x of distance, the light's x² less bright). Ironically, that means we're more likely to detect signals from an improbably close civilization (like 4 light years next door, in Alpha Centuari), than from farther away -- and even then, by a chance sweep of an umodulated asteroid scanning beam[0] or something, if we happened to be paying attention at the time.
0: https://en.wikipedia.org/wiki/BLC1