That's just bulls... People have a live besides work. Kids, family, spouses, hobbies, ... a lot of things have an influence where people can realistically live.

And furthermore, even if everyone was that free-roaming, only-working, highly-paid software developer you seem to consider average, still there wouldn't be enough living space really close to many offices for all employees.