News for hackers. Stuff that matters.
Re:America's first law regulating AI bias in hiring takes ef... by jncfhnb on Sunday July 09, 2023 @07:13PM (#36660060)
While a lot of people will state those are appropriate goals, they are not. They’re really dumb goals. The model being equally bad for each group is not an indicator that you have achieved anything. Most likely you’ve just made your model for white people worse.

Like, let’s look at that for credit decisions. Black folks have a lower income distribution. So it’s like saying the model is ok if it rejects a Black applicant making 80k if it would also reject a White candidate making 100k. That is the insane bullshit you’re effectively supporting by desiring comparable error distributions.

You have to accept that equal outcomes are not just impossible but not desirable. And then you only use fields that people agree are fair to use. If Black people get disproportionately better or worse outcomes it is either because those outcomes make sense given their stats or it’s not ok because if a White dude had the same info, that you agree is fair to use, they would have passed and the underlying reason for the difference is some bullshit other input.

That might mean that the model is a dumb: you must make $100k for this loan (illustrative) which is going to mean a lot of Black folks cannot get it. Well that model is at least “fair”. Accommodations for race should not be coming from an AI model

Re:America's first law regulating AI bias in hiring takes ef... by parpfish on Sunday July 09, 2023 @11:01PM (#36661546)
Agree to disagree
Re:America's first law regulating AI bias in hiring takes ef... by jncfhnb on Monday July 10, 2023 @08:06PM (#36674829)
I would love to hear a counter argument that explains why having all models perform equally bad is desirable.