Probably only up to a point.

I ride a motorcycle and carry my phone in a pocket that's outside the thermal lining. I absolutely see the difference in how much it discharges when it's ~5ºC vs above 15ºC. And I'm thinking of the trip to my parents' house, so same duration, speed, and phone station locations.