Also, space is pretty big. Even with a million destroyed satellites out there, the total density of debris would be very low. Imagine spreading debris of a million destroyed cars all over the planet - including the oceans - then walking around and trying to spot a piece. How often would you even see one, much less happen to walk directly over it (=equivalent of a collision)?
They are quite concerned about that particular outcome, Kessler wasn’t just warning us, but predicting an outcome.
NASA sent China a nasty letter the last time China shot down one of its own satellites.
The why is simple. There are launch windows. The more debris in orbit the smaller the windows and shorter their availability.
I believe you overestimate how much orbital debris it would take to ground earthlings for centuries.