Face-to-face planning and decision-making is crucial for fully distributed teams for exactly this reason. So you need to take the money you save not having an office and put it into travel and regular in-person meetings. Somewhere nice!