The issue is keeping things in orbit not space exploration. Realistically going through is never going to be a problem. The worst that might happen is that you need some monitoring and manoeuverability on-board of your spacecraft but it's not insurmountable. Even near Earth, space is that big.

Staying there with a lot of debris flying around really fast that could become impossible.

_Your_ launch will be very unlikely to be hit by debris, but _one of_ the 86400 manned spaceflights per day will be hit. And now you've lost not only the 200 souls onboard but also a portion of the city that the suborbital spacecraft was on a trajectory towards as the punctured hull falls short of the landing pad.

The problem is the viability of technology we actually rely on nowadays: global positioning, weather prediction, surveillance and satellite communication. Space exploration is pretty low on the list of reasons people should worry about debris in orbit.