If everyone and every object in the world is connected to the network continuously with high bandwidth, why would they need to visit a building in the middle of a city in order to work with others?

That's a post-office world, and one which will come before our concept of work as the necessary foundation of an existence is eliminated (though on a long enough time frame, that's probably coming too).