News for hackers. Stuff that matters.
Re:Amazon scraps secret AI recruiting tool that showed bias ... by jakelazaroff on Wednesday October 10, 2018 @11:19AM (#18185673)
> What about cases where the features are just merely correlated with a subpopulation of a protected class?

This question can be rephrased as "is there a difference between de facto and de jure discrimination?"

My answer is no, causality doesn't matter here: if feature A is a good predictor that some person belongs in group B and not group C, then filtering out feature As is effectively the same as filtering out only group Bs.

Re:Amazon scraps secret AI recruiting tool that showed bias ... by darawk on Wednesday October 10, 2018 @12:17PM (#18186292)
Ok, so if you're hiring professional arm wrestlers, and your model looks at bicep muscle mass, is that discrimination because it selects against women?

If you're hiring therapists, and your candidates take a personality test, and your ML model weights the 'nurturing' feature highly, is that discrimination because it selects against men?

Re:Amazon scraps secret AI recruiting tool that showed bias ... by jakelazaroff on Wednesday October 10, 2018 @12:36PM (#18186482)
Underlying your examples is the implication that a preference shouldn't be considered discriminatory if the trait being selected for correlates with fitness. I agree with this position!

What I don't agree with is the assumption that, in this case, the preferred traits do correlate with fitness, since there's at least one — gender — for which this model is biased even though it has no apparent correlation.

Re:Amazon scraps secret AI recruiting tool that showed bias ... by darawk on Wednesday October 10, 2018 @12:43PM (#18186565)
Ya, I just mean to say that uncorrelation with fitness is an important qualifier.
Re:Amazon scraps secret AI recruiting tool that showed bias ... by gfodor on Wednesday October 10, 2018 @12:35PM (#18186477)
Separate it one step further -- hiring decisions are all too easy to pin as discriminatory. What if a site shows ads for a special offer on protein shakes for people with higher bicep mass since they are in the target market? Is that discriminating against women?
Re:Amazon scraps secret AI recruiting tool that showed bias ... by rrcaptain on Wednesday October 10, 2018 @11:02PM (#18190718)
How the hell are you targeting ads with "bicep mass"?