The issue is that most people who want to be in office want to be in-person. The location is secondary to the fact that you’re with your coworkers in person.

If coworker A prefer digital communication, and coworker B prefers in person communication, then there is no way A and B can both be happy. A can stay at home, and B can go to office, but B is now far from home (commuting) but still over zoom. The only way to not waste people’s time is for All remote, or for A to completely not get their way and get dragged in person.