We actually have an office. It’s over an hour commute away from me. And I have school-aged children that I have to prepare and drop off in the mornings. None of my co-workers work there. So I basically never go.
At my last job I did have an office that was within walking distance. My children were much younger. I had a dedicated desk and office. And I managed to make it in every day.
Commutes are a big factor in the decision. For a lot of reasons. Climate, expense, convenience, etc.
We lost that space and switched to a lab about 10 minutes away. It's amazing what a difference that made! We go in more often because the psychological cost is so much lower.
We could have rented lab space that is less than 5 minutes' walk for me, but no such luck.
For example, if you lived in Mountain View in walking distance of Google, would you turn down an offer from Facebook because your home in Mountain View is no longer walking distance to Facebook HQ?
Also, life situations. If your partner has a job at a school or hospital that requires physical presence whose commute do you prioritize?
Making jobs that can be remote, remote gives workers massive flexibility in work arrangements with partners as well as being able to change jobs.
There's a part of me that wonders if part of what's going on here is a cadre of genxers who are so wealthy as to necessarily be out-of-touch don't realize that typical millennials' and zoomers' socioeconomic reality is not, and cannot reasonably be forced to be, similar to that of boomers and the greatest generation.
A lot of people did move to Manhattan for finance. But most left after they gained partners and kids.
In general, I suspect a lot of younger/better-educated/wealthier folks have latched onto some of the more elite cities, when they might not have done so in the past, but may not stay there over time.