"Our sidewalks are narrow and crowded, will pedestrians just move to the streets?"

I hope so. If drvierless cars allow pedestrians to safely reclaim the streets that, as you point out, have marginalized them for so long, then that's fantastic.