When you’re married with a working spouse, it becomes much harder.

Then when you have kids you need to think about where they go to school and you might want to live close enough to grandparents that they can help out. These constraints make living close to work impossible for a huge chunk of people.