The jumper explanation is interesting, but it has a hidden catch.

While the Stone Age people who first came up with clothing certainly didn't understand heat flow equations, they still had to think in advance about the coming cold snap and make preparations: hunting down some game for its coat, skinning it etc. Quite a sophisticated set of actions, not a mere instinctive response to changing temperature.