Building airports is already difficult, because they require a lot of space and cause a lot of noise. People also oppose them for environmental reasons or simply because they don't like them. Spaceports are going to be worse in every aspect.

I don't see spaceports appearing in the densely populated areas of Europe or US East Coast or in LA, and definitely not in the Bay Area. You have to build them in remote areas or in international waters, and then you have to pair them with a conventional airport or with high-speed rail.