You think a large share of pre-settlement humans lived in non-(sub)tropical regions? I don't think so. We mostly staying in the warmth, and the few daredevils that left had a hard time.