News for hackers. Stuff that matters.
Re:New Jersey’s experiment to reduce the number of people in... by opportune on Monday November 27, 2017 @01:41AM (#15785340)
Another problem in the same vein is that when ML algorithms make use of Bayesian inference they can bake in correlations ( e.g. between race and credit score) that we would normally purposefully avoid using as a factor, because while it enhances predictive power, it again codifies our existing biases, prejudices, and injustices. For example if you were deploying an ML model to determine whether someone deserved a loan, features such as ZIP code or race could encode discrimination into the model
Re:New Jersey’s experiment to reduce the number of people in... by maxerickson on Monday November 27, 2017 @08:13AM (#15787008)
Including race as a parameter should reduce the impact of those correlations on the output of the model (by allowing the model to measure and control for the bias that exists in the input data).

Incautiously using race just because it reflects those existing biases would be a problem. This is what lots of humans do, overestimating the information provided by their own inferences of race. Like internet assholes who blather about how it is rational to be afraid of black men because of their higher rates of assault. Never mind that the absolute rate is still so low that there is ~0 predictive power from the race of a given individual.

Re:New Jersey’s experiment to reduce the number of people in... by azernik on Monday November 27, 2017 @09:08AM (#15787397)
That's actually a very interesting idea for a technique. But not one I've ever heard of actually being used.
Re:New Jersey’s experiment to reduce the number of people in... by maxerickson on Monday November 27, 2017 @09:53AM (#15787746)
It's not a technique, it's a natural outcome of statistical modeling.

It doesn't get used because people are innumerate and reactionary.

Re:New Jersey’s experiment to reduce the number of people in... by azernik on Monday November 27, 2017 @12:54PM (#15789354)
The technique I'm referring to is including race as a factor, and then instructing your model to disregard that factor. Not being race-blind, but being race-aware while attempting to be neutral to race.
Re:New Jersey’s experiment to reduce the number of people in... by opportune on Monday November 27, 2017 @01:25PM (#15789709)
Yeah I think this is an interesting idea but I don't actually understand how the great-grandparent comment believes that this could be done. I don't think it works in a strict Bayesian sense. You would have to go out of your way to instruct your model to operate correctively
Re:New Jersey’s experiment to reduce the number of people in... by CoongLiu on Monday November 27, 2017 @05:04AM (#15786180)
By definition, any model is basically bound to be discriminatory. Taking data, extracting common key features, and discarding the rest is essentially generalisation.

But the model is amoral. It's (morally) neither good nor bad for utilising certain features.

If it turned out that race was the most accurate attribute for a particular situation, it would be nonsensical ignore it.

The current trend of trying to paper over biases, while generally born of noble sentiment, probably only perpetuates the problem. Because it's usually done far down stream, and doesn't necessitate change at the source. Functionally, it's like a cover up by a large corporation

Re:New Jersey’s experiment to reduce the number of people in... by ufo on Monday November 27, 2017 @06:36AM (#15786593)
> If it turned out that race was the most accurate attribute for a particular situation, it would be nonsensical ignore it.

Only if you are optimizing for prediction accuracy. If you want to optimize for something like "justice" or "citizen wellbeing" then you might want to come to a different conclusion