Presumably, this isolation would be less of a concern with mixed reality. Just place “the game” in a shared middle of the room and blend your friends into the stands.