Musicians want/need to hear each other. This is obvious for improvised music, but even when everything is written out, players have/want to listen to each other.

While this approach certainly works from a technical perspective, but I don't see many musical styles where this would yield a satisfying musical result. However, it might work for pieces which are specifically written for this constellation.