A.I. Systems Echo Biases They’re Fed, Putting Scientists on Guard

Re:A.I. Systems Echo Biases They’re Fed, Putting Scientists ... by manfredo on Wednesday November 13, 2019 @03:35PM (#21529228)

And that "something" we want the AI to do is usually grounded in the real world in some way, be it shopping patterns, or crime. And the real world has disparities.

For example, crime rates are not equal between men and women. If we force our AI to assign equal risk of crime to men and women then we will have introduced a bias that either under predicts the rate of male crime, or over prdicts the rate of female crime.

[ Parent | on HN ]

Re:A.I. Systems Echo Biases They’re Fed, Putting Scientists ... by loopz on Wednesday November 13, 2019 @04:47PM (#21529972)

"Truth" is irrelevant and academic.

What matters is: What are the outcomes and consequences of active systems, AI or not.

For instance: How do the algo cope with derivatives of its own output being fed into itself as input at a later stage?

[ Parent | on HN ]

Re:A.I. Systems Echo Biases They’re Fed, Putting Scientists ... by manfredo on Wednesday November 13, 2019 @05:47PM (#21530566)

If truth is irrelevant then just return random output and call it a day.

The reality is, truth is relevant and sometimes the truth is inconvenient. Tech workers may want to build an AI that measures risk of recidivism that produces uniform risks across race and gender. But the truth is, rates of recidivism is not the same across all groups. If we produce the desired outcome of equal reporting of risk, then the consequence is that men have their risk underreported to put them on parity with women, or vice versa.

[ Parent | on HN ]