> There will never be enough debris that we can't fly through LEO.
Flying through and flying through safely are very different things. With tens of thousands of objects in and below LEO and (presumably) increasing flights to orbit, it's only a matter of time until a rocket gets taken down. It doesn't require a particularly large piece for an involuntary update to your deorbiting plans.
It's not.
The concern is that unwanted collisions will become common enough that satellites break down or are completely destroyed within months. There will never be enough debris that we can't fly through LEO.