Last time I was at a company that tried that, the (US-based) management would fight over making sure their projects went to the US-based devs (even if not in the same office) vs the overseas devs because the communication gap - timezones and physical distance both - was that bad.

Zoom hasn't fixed this.