I always thought fair skin in parts of the world meant that you weren't working class (e.g. worked outside in the sun)