There is an implication as well, though, that there is an additional self-selection towards having dictation on how to live your life from a greater power among those who prefer working in offices, seeing those people self-select businesses that have mandated location requirements. That is what we are exploring here.
This, right here, explains the pushback against those who favor in-office work; it's not that they simply want to be in the office, but they want their colleagues to make the commute to join them in the office and chat with them.
Conversely, remote workers do not place any such requirements on where their colleagues work. They aren't requiring that anyone else be in a specific location at a specific time, hence why it is better and more accommodating to others.