I always see it like this, if it's cold you can put on more clothes (you probably already have them, and they don't waste energy to wear). When it's hot, there's a certain societal lower threshold for what you're allowed to wear in an office (depending on the office shorts are ok, but not less). So you can't individually cool down.