That's fine, except it goes back to the original point that you are essentially forcing a culture of in-person work unnecessarily on everyone, because a portion of people are either too lazy or otherwise incapable of socializing with anyone outside of work.