It would probably make some difference at the margins. But I'd be willing to bet that, for the majority of people who don't want to go into an office or at least go in frequently, the driving factor is probably a commute. I'm pretty much fully remote but, if I would walk 15 minutes to our downtown office rather than drive >30 minutes to our suburban office, I would probably drop in semi-regularly for the change in scenery.
To me it wouldn't, I live in the middle of no where near my family, I couldn't work for big tech and stay here. But I bet it'd shift a lot of opinions.