Assuming you're driving yourself, this is universally a productivity killer. You risking a huge amount of frustrating and angering situations while your workers are commuting to a central location. I'd put good money on a lot of lost productivity to commute.

Then there's the people who have to commute, due to functionally in-person jobs (artisans, doctors, baristas, etc.). Optional commuters going to the office for their "social fix" are doing so at the expense of forced commuters. Work should be work and social should be social; if you want a social experience during work hours then have a social lunch in your neighborhood.