What difference does it make whether their reasons are the same as mine or different from them?

You're right it wouldn't matter. I think I had a brain fart here. What I wanted to say was the thing with 'everybody has a point of view' is that not all points of view are equally represented in the population. I'm not going to dismiss the viewpoint of the people who do like coming in to work, if one person hates it. It would be nice to accommodate everyone's individual preferences in every situation, but realistically you can't make everyone happy if they're outside of whatever standard deviation a workplace can manage.