As I understand, there is no 'out-weighing' - holding other factors constant, their adversity score would be even higher if their neighborhood had more crime, or spoke worse english.