Re:Attacking discrimination with smarter machine learning
by reader5000 on Monday November 21, 2016 @09:11AM
(#13005450)
I dont think most ML algos are as black box as you think, and if there were such an algo that regularly had a problem with finding "irrelevant correlations" then it wouldnt be a very good ML algo and people wouldn't use it.
[ Parent
| on HN ]
Re:Attacking discrimination with smarter machine learning
by deong on Monday November 21, 2016 @10:09AM
(#13005906)
You're conflating algorithms with data to some degree. The algorithm is responsible for finding the correlation, but whether that correlation is "irrelevant" depends entirely on the relationship between the training data and the full (presumably unknown) distribution over that set, as well as on fuzzy social interpretions (e.g., we may simply decide by fiat that race is an irrelevant feature for deciding mortgage approvals because we want to enforce that as true within the system).