There is an implication as well, though, that there is an additional self-selection towards having dictation on how to live your life from a greater power among those who prefer working in offices, seeing those people self-select businesses that have mandated location requirements. That is what we are exploring here.
This, right here, explains the pushback against those who favor in-office work; it's not that they simply want to be in the office, but they want their colleagues to make the commute to join them in the office and chat with them.
Conversely, remote workers do not place any such requirements on where their colleagues work. They aren't requiring that anyone else be in a specific location at a specific time, hence why it is better and more accommodating to others.
Remote doesn't specify where you work, though. In my 20 years of working remotely, I've worked from home, from cars, hotels, cafes, offices, out in the middle of a field, you name it I've probably done it. 100% remote working conditions can mean working in an office environment every single day, if that's your preference. Remote is a euphemism for "work wherever you please".
The actual differentiation here is whether or not an employer dictates a working location. Are you, perhaps, suggesting that there is strong overlap between those who prefer working in offices (which does no preclude 100% remote) and having a controlling power dictate how they live?