News for hackers. Stuff that matters.
Re:What does it mean for an algorithm to be fair? by theseatoms on Monday July 13, 2015 @11:22AM (#9878662)
There are two separate issues being discussed at once: 1) baseless prejudice, expressed en masse, and therefore gaining algorithmic notability, and 2) empirically backed, statistically defensible stereotypes.

This second issue seems harder to resolve, because it will require lawmakers to clearly articulate a "bright line" law in the language of the algorithm itself. As the article acknowledges, algorithms can "learn" race, even if race is not an explicitly defined explanatory variable.

Looking forward to part two.

Edit: Why race? Because it's an obvious and easy example. I believe the author would be on board with your height example.

Re:What does it mean for an algorithm to be fair? by murbard2 on Monday July 13, 2015 @11:32AM (#9878750)
Regarding the second issue, Griggs v. Duke Power Co. asserted that requiring a high-school degree for a job that arguably didn't strictly require one was discriminatory because it could act as a proxy to race.

If the author is on board with height, I can take him down all the way to a reductio where you give everyone the exact same credit terms.

Re:What does it mean for an algorithm to be fair? by theseatoms on Monday July 13, 2015 @11:43AM (#9878826)
Well hopefully that case doesn't hold too much power via legal precedent, which is a concept I never fully understood.

I can very much appreciate your reductio argument, but if i had to wager, that's the way we're headed. Seems like aspiring lawyers should start cracking open the ML textbooks, because that case is a pandora's box.

Re:What does it mean for an algorithm to be fair? by gohrt on Monday July 13, 2015 @03:52PM (#9880583)
> statistically defensible stereotypes.

"defensible" is a weasel word.

It goes back to the old "correlation vs causation"

Machine learning choose the "shape" of a decision surface. Optimizing parameters of that surface may be defensible, or may nor be. Your algorithm may learn that people with my skin color, or who live in my neighborhood, on have a certain average behavior on your objective function.

I would word your #1 and #2 as (1) baseless prejudice that midjudges people in general, (2) statistical prejudice that misjudges many individuals.

But it's still a leap to treat me as the "average" in that group, instead of judging me on the content of my character. What guided your choice of parameters? Even if you did the best within practical limits, it still may be unfair.

Re:What does it mean for an algorithm to be fair? by theseatoms on Monday July 13, 2015 @05:18PM (#9881173)
Point taken. Though, for better or worse, correlation can very frequently meaningfully improve the decision-making process, whether the organization employing said algorithm is lending to consumers or something else.