It happens in houses too. People will run their heater warmer than they cool their house to in summer. My theory is that the wall temperature is causing more or less radiant heating and the thermostat gets adjusted to compensate. So if the car body is much hotter it will feel hotter even with the same air temp.