> Public transportation was so-so. And getting places wasn't convenient always. Shopping for food involved walking more than we wanted (especially in cold or rain). It wasn't terrible and I can see benefits to it, but it was also not that great either.

Before I was 10 I lived in an urban area. It was pretty much exactly this. After that we moved to an ultra-rural area. When I was old enough I swore I would move back and I did, but within a couple years realized that there are lots of downsides exactly as you describe here. I'd add that close proximity to near constant violence is also a problem in many urban areas.

I finally left when my downstairs neighbor was violently stabbed in his own apartment.

This was in one of the low-crime areas.