Re:Amazon scraps secret AI recruiting tool that showed bias ...
by darawk on Wednesday October 10, 2018 @12:17PM
(#18186292)
Ok, so if you're hiring professional arm wrestlers, and your model looks at bicep muscle mass, is that discrimination because it selects against women?
If you're hiring therapists, and your candidates take a personality test, and your ML model weights the 'nurturing' feature highly, is that discrimination because it selects against men?
Re:Amazon scraps secret AI recruiting tool that showed bias ...
by jakelazaroff on Wednesday October 10, 2018 @12:36PM
(#18186482)
Underlying your examples is the implication that a preference shouldn't be considered discriminatory if the trait being selected for correlates with fitness. I agree with this position!
What I don't agree with is the assumption that, in this case, the preferred traits do correlate with fitness, since there's at least one — gender — for which this model is biased even though it has no apparent correlation.
Re:Amazon scraps secret AI recruiting tool that showed bias ...
by darawk on Wednesday October 10, 2018 @12:43PM
(#18186565)
Ya, I just mean to say that uncorrelation with fitness is an important qualifier.
Re:Amazon scraps secret AI recruiting tool that showed bias ...
by gfodor on Wednesday October 10, 2018 @12:35PM
(#18186477)
Separate it one step further -- hiring decisions are all too easy to pin as discriminatory. What if a site shows ads for a special offer on protein shakes for people with higher bicep mass since they are in the target market? Is that discriminating against women?
This question can be rephrased as "is there a difference between de facto and de jure discrimination?"
My answer is no, causality doesn't matter here: if feature A is a good predictor that some person belongs in group B and not group C, then filtering out feature As is effectively the same as filtering out only group Bs.