Honestly, it's people with lives external to work (families, hobbies, friends, kids) seeing people with nothing better to do than hang out in the office all day seizing the inside lane wrt office politics by doing stuff that's not related to their actual work at all. I don't know necessarily whether that's unfair, as a manager might see somebody with nothing better to do with their time but work as an asset, but I can empathize with the resentment.