I think it refers to downstream effects of intelligence and aptitudes. For example if I'm really smart, and I make a lot of money and leave my children a generous inheritance, their privilege is a residue of my gifted aptitude.