News for hackers. Stuff that matters.
Re:America's first law regulating AI bias in hiring takes ef... by jncfhnb on Sunday July 09, 2023 @10:43AM (#36654847)
The only way to do this is to whitelist acceptable input variables. Detecting bias is a meaningless exercise.
Re:America's first law regulating AI bias in hiring takes ef... by scrps on Sunday July 09, 2023 @11:24AM (#36655231)
Just don't apply ML as a solution?

Even without the bias issues, if I were a hiring manager how do I verify that the weights "MagicHireAI SaaS Corp" are using aren't leaving swaths of talent on the table that I don't even know exist?

Re:America's first law regulating AI bias in hiring takes ef... by WirelessGigabit on Sunday July 09, 2023 @11:39AM (#36655373)
My wife recently went through multiple applications after a stint of no work permit.

The amount of stuff they make you fill out that is then parsed with AI is insane.

Indeed ruined a lot. Before if you had an ok resume but we're able to talk to them in person you might be able to convince them.

Now with all those aptitude training you have to do well there.

Not to mention the applications that require you to turn on your webcam (!) while you do them. Disgusting.

That last one by the way was the same company where my wife had an in person interview. She drove there. The interview was on Zoom with somebody in another office.

She declined the offer. Wastefulness and already showing that they're not against monitoring by AI means 0 humanity.

Re:America's first law regulating AI bias in hiring takes ef... by geraldwhen on Sunday July 09, 2023 @11:41AM (#36655395)
Driving plus zoom describes many corporate jobs I think. How many of us are required to drive to an office to take remote meetings? I imagine a lot.

I know I have to.

Re:America's first law regulating AI bias in hiring takes ef... by rovr138 on Sunday July 09, 2023 @03:43PM (#36658115)
I imagine not a lot.

I know I don’t have to.

Re:America's first law regulating AI bias in hiring takes ef... by Version467 on Sunday July 09, 2023 @11:53AM (#36655540)
> Not to mention the applications that require you to turn on your webcam (!) while you do them.

I don't understand what this means. Did she have to turn on her webcam to upload her cv? How does that even make sense.

Also, how is that legal? I thought requiring a photograph to apply for a position is illegal (except for stuff like acting).

Re:America's first law regulating AI bias in hiring takes ef... by humanistbot on Sunday July 09, 2023 @12:05PM (#36655665)
The idea is that you keep your webcam on your face while you fill out the application for identity verification, to make sure it is actually the applicant. But if you think that's bad, the hot new thing in these hiring startups is that you have to record yourself answering interview questions with some chatbot interviewer, and then some black box model scores it to give you all kinds of psychometric astrology even worse than Myers Briggs. Except it's a bunch of AI snake oil, and as the article says, you get different personality scores if you put on a headscarf or glasses.

In the US, it is illegal per the EEOC, which has barely any resources to actually enforce the law: "Similarly, employers should not ask for a photograph of an applicant. If needed for identification purposes, a photograph may be obtained after an offer of employment is made and accepted." [1]

[1] https://www.eeoc.gov/prohibited-employment-policiespractices

Re:America's first law regulating AI bias in hiring takes ef... by lotsofpulp on Sunday July 09, 2023 @01:02PM (#36656236)
It is not illegal to ask for a photo. “Should not ask” is not the same as “cannot ask”.

Asking for a photo opens an employer to claims of discrimination, but it would still have to be proven, so the government is advising against it. But it may well be that in practice, the government will not be spending resources on trying to or be able to prove discrimination, even if a photo is required.

Re:America's first law regulating AI bias in hiring takes ef... by peterfirefly on Sunday July 09, 2023 @12:03PM (#36655640)
There is a lot of cheating going on... This is a way to avoid some of it.
Re:America's first law regulating AI bias in hiring takes ef... by phatskat on Sunday July 09, 2023 @12:07PM (#36655683)
This doesn’t make sense - cheating on what?
Re:America's first law regulating AI bias in hiring takes ef... by brasic on Sunday July 09, 2023 @12:20PM (#36655799)
From OP:

  > Now with all those aptitude training [...] that require you to turn on your webcam
They are referring to an automated personality or skills test to screen candidates. The webcam is to make sure the applicant is the one actually doing the test. These things are dehumanizing and snake-oil but there’s’s no question that applicant misrepresentation happens, including situations where the person interviewing is a ringer being paid by an agency or the applicant.
Re:America's first law regulating AI bias in hiring takes ef... by phatskat on Sunday July 09, 2023 @12:29PM (#36655894)
I guess I don’t understand how cheating on these things benefits the candidate. Like, you lie about any of that and get put in front of a panel, how’s that going to go?
Re:America's first law regulating AI bias in hiring takes ef... by crooked-v on Sunday July 09, 2023 @01:16PM (#36656379)
Generally the people trying to fake their identity or skills in interviews are doing so with remote jobs, with the goal of bumbling along indefinitely once they no longer need to be on camera.

The problem here is that companies have now gone from identity verification to this 'aptitude test' ML bullshit that's just another cover for increasingly weird arbitrary discrimination against applicants.

Re:America's first law regulating AI bias in hiring takes ef... by humanistbot on Sunday July 09, 2023 @01:27PM (#36656537)
See this HN thread for all kinds of experiences with hiring fraud: https://news.ycombinator.com/item?id=32996457

It doesn't benefit genuine candidates to blatantly lie. They'll get caught later in the process. But you're assuming identity thieves are acting rationally or fear getting caught. They don't, and they're playing a numbers game. If you get past an interviewer and get fired after two weeks, your salary at a US tech company can be $5k, which is the average annual salary in many developing countries.

Re:America's first law regulating AI bias in hiring takes ef... by bobthepanda on Sunday July 09, 2023 @01:15PM (#36656357)
I would assume this is an attempt to catch people who hire impersonators for the interview early.
Re:America's first law regulating AI bias in hiring takes ef... by peterfirefly on Sunday July 09, 2023 @02:44PM (#36657550)
Precisely.
Re:America's first law regulating AI bias in hiring takes ef... by Tangurena2 on Monday July 10, 2023 @12:49PM (#36669050)
I don't know about other folks here, but in the past decade, we've encountered recruiters who present one candidate when doing a telephone interview and then a different person shows up for the in-person interview.
Re:America's first law regulating AI bias in hiring takes ef... by tomrod on Sunday July 09, 2023 @01:05PM (#36656260)
Those of us with authority to hire should reject these snake oil practices. What a waste of time to only get candidates who are okay sitting through these dehumanizing experiences.

Don't pay for this cruft, sponsor local meetups instead.

Re:America's first law regulating AI bias in hiring takes ef... by coffeefirst on Sunday July 09, 2023 @11:27AM (#36655261)
Yes. All these solutions are snake oil. Resumes are BS—it’s the very definition of garbage in garbage out. I don’t need an AI to sort candidates, I need really fast organizing tools.
Re:America's first law regulating AI bias in hiring takes ef... by jncfhnb on Sunday July 09, 2023 @11:30AM (#36655286)
Looking at the outcomes and validating whether or not they make sense
[dead]
Re:America's first law regulating AI bias in hiring takes ef... by alphazard on Sunday July 09, 2023 @11:17AM (#36655150)
White and black are technical terms used in physics and electrical engineering. White means all of the components of the spectrum and black means none of the components of the spectrum.

White noise contains all the frequencies. Black body radiation is radiation due to heat emitted from an object which does not reflect any light (is black).

That is the etymology of whitelist and blacklist.

Re:America's first law regulating AI bias in hiring takes ef... by Springtime on Sunday July 09, 2023 @11:27AM (#36655254)
> That is the etymology of whitelist and blacklist.

It's hard finding a definitive source for blacklist, though first I've read said to be from that sense. Many centuries old examples I've seen when looking this up seem to have already had it as some in-use vocabulary.

Edit: huh, entire parent thread has been entirely hidden on HN. I suppose it was too much of a digression.

Re:America's first law regulating AI bias in hiring takes ef... by tsimionescu on Sunday July 09, 2023 @01:10PM (#36656317)
The etymology of blacklist in English seems to be more related to a list of his enemies that Prince John (of Robin Hood fame) made of his enemies. Most likely the word is related to the MUCH older association between the color black and death in much of Europe.

Still, nothing to do with black or white skin or any bias against people of different skin colors, so not contesting your actual point.

Re:America's first law regulating AI bias in hiring takes ef... by lotsofpulp on Sunday July 09, 2023 @01:26PM (#36656520)
>Most likely the word is related to the MUCH older association between the color black and death in much of Europe.

I would have thought it would have something to do with darkness/night versus bright days/day, where people experience more danger in the former than the latter for obvious reasons.

Re:America's first law regulating AI bias in hiring takes ef... by getmeinrn on Sunday July 09, 2023 @10:56AM (#36654966)
To those of you thinking of debating the above, remember, you cannot win the word game. The more you oppose someone telling you not to use a word, the more racist you appear, no matter the actual origins of the word in question. It simply doesn't matter. The only way to not be seen as a racist is to apologize and use whatever words they tell you to use.
Re:America's first law regulating AI bias in hiring takes ef... by tekla on Sunday July 09, 2023 @11:03AM (#36655037)
No. The thing to do is ignore the dumb and irrational and continue to use normal words like "blacklist" and "whitelist"
Re:America's first law regulating AI bias in hiring takes ef... by peddling-brink on Sunday July 09, 2023 @11:18AM (#36655161)
I don’t think any rational people are offended by the word “blacklist”.

I do think there is some validity to the change.

Black lists are lists of bad things that need to be blocked or prevented, white lists are things that are good and allowed and wanted. That does create an unsavory connotation with the words themselves.

Furthermore, as someone in an industry that used blacklist and whitelist extensively, noobs screw up those words all the time. It’s not a very clear word. Blocklist and allowlist are much less ambiguous.

Re:America's first law regulating AI bias in hiring takes ef... by phatskat on Sunday July 09, 2023 @12:11PM (#36655730)
This is the correct response. The origins of the terms are less important here, and often people get hung up on them.

Whitelist and blacklist are indeed ambiguous, and they also create negative connotations that could reinforce other, actually racist views and language, whether conscious or not.

Re:America's first law regulating AI bias in hiring takes ef... by flangola7 on Sunday July 09, 2023 @01:29PM (#36656579)
I most enjoy the terminology updates because anyone that throws a fit about the change outs themselves as a can of worms and a person to keep away from your life or payroll. IME it's a heuristic with 100% accuracy.
Re:America's first law regulating AI bias in hiring takes ef... by getmeinrn on Sunday July 09, 2023 @01:55PM (#36656945)
This reads like you enjoy antagonizing people, so I'm sure the feeling is mutual. Who would want to work with/for someone who enjoys agitating their peers or subordinates? Do you ask them their stance on abortion and free speech too?
Re:America's first law regulating AI bias in hiring takes ef... by jncfhnb on Sunday July 09, 2023 @11:06AM (#36655062)
You can also win this game 99% of the time by just not living in California. It’s really just a local power struggle that some people mistakenly believe is a national dialogue.
Re:America's first law regulating AI bias in hiring takes ef... by jupp0r on Sunday July 09, 2023 @11:23AM (#36655216)
It might blow your mind, but did you know there are even other countries in the world that are not the USA?
Re:America's first law regulating AI bias in hiring takes ef... by blueflow on Sunday July 09, 2023 @11:15AM (#36655135)
You are the person attributing a racial issue to random words.

But hey, i can do that, too:

> no matter the actual origins of the word in question

> The only way to not be seen as a racist is to apologize and use whatever words they tell you to use.

Please stop using the words "debating", "win", "game", "oppose", "racist", "apologize". They are highly offensive and racist vocabulary.

Re:America's first law regulating AI bias in hiring takes ef... by Spivak on Sunday July 09, 2023 @11:43AM (#36655416)
And the reason for this is because for most people a word substation is a zero effort change that simply doesn't matter one way or another. And if one way is better for whatever reason then sure, why not? One side cares because they're trying to eliminate bias and be inclusive, the other side cares because…?

"words have meaning": this is a right wing dog whistle, even if you are a true language prescriptivist no one will believe you.

"it's stupid": just makes you look like an asshole when someone is trying to do something people see as in good faith.

"it's pointless": then why does it matter one way or another? Goto other reason.

"it's not racist": when we're talking about blacklists it never was, it's about trying to not always associate black with the negative connotation, but you look really racist for wanting to keep it.

"black outside the context of race does have negative connotations in humans, you can't change that we're afraid of the dark": now you look really really racist.

Re:America's first law regulating AI bias in hiring takes ef... by getmeinrn on Sunday July 09, 2023 @12:09PM (#36655714)
Have you ever considered that people don't like being told how to behave by unlikable people? And that language policing by definition makes you unlikable? When was the last time you told someone not to use a word and they said "you know what, I like being told how not to speak." ? It's maybe the quickest way to tell everyone that you're insufferable.

So basically you're "proving" to yourself that everyone is either racist or an asshole, by creating a situation where people don't want to listen to you because you're insufferable. But you can pretend to be virtuous because you're doing it for some make believe greater good about the word "whitelist."

BTW I'm actually trying to help you see the reason there's resistance. I use "allowlist" and "denylist" voluntarily in my OSS repos, because it doesn't really matter to me. But I still find people who make it their moral imperative to police these words insufferable. From my perspective, you either don't know that, which shows you have no tact, or you don't care, which shows that you're doing this in bad faith.

Re:America's first law regulating AI bias in hiring takes ef... by Spivak on Sunday July 09, 2023 @04:38PM (#36658620)
You're writing this like I don't agree with you and do the exact same thing. Explaining the social dynamics at play doesn't mean I agree with them.

> When was the last time you told someone not to use a word

Literally never. Again you assume a lot about me. I am speaking purely from the perspective of being told to use different words. It's never really bothered me. My response has always been "sure whatever." Some of them are a stretch but a lot of them make sense.

Re:America's first law regulating AI bias in hiring takes ef... by getmeinrn on Sunday July 09, 2023 @05:10PM (#36658930)
You listed every other reason why someone would resist being policed about the word "whitelist", except the "you're being obnoxious" reason. In my experience, that's the far more common reason. Instead, you seem fixated on the racist reasons, since you mention them multiple times.

Believe it or not, people are more likely to be put off by obnoxious word police than they are to be racist.

Re:America's first law regulating AI bias in hiring takes ef... by Spivak on Sunday July 09, 2023 @07:31PM (#36660185)
> you seem fixated on the racist reasons

Okay let's go back to the beginning here.

> The more you oppose someone telling you not to use a word, the more racist you appear, no matter the actual origins of the word in question.

And I expounded why -- literally agreeing with you. Then you called me insufferable. If people took "you're obnoxious" as a valid defense then there would be a way to win the game. Your entire point is that all roads lead to racism and then got defensive when in fact all roads lead to racism. As much as it would be fun to be an omnipotent benevolent dictatress, am I in fact not and have no power to change how people behave.

Also you're clearly mad about word policing but your gripe with them is that you think the way they deliver the message is obnoxious and insufferable. But since you did voluntarily switch up your wording you clearly have no issue with the message itself. Which means you're tone policing. I bet some folks view you the same way you view them.

Re:America's first law regulating AI bias in hiring takes ef... by roenxi on Sunday July 09, 2023 @11:04AM (#36655055)
The problem with "allowlist" is it is an ugly phrase that sounds like it was dreamt up by a bureaucrat. There is a reason we have blacklist and whitelist - they roll off the tongue. The move from master -> main was silly but at least technically superior because it is easier to say and type. "Blocklist" and "Allowlist" are worse words than "blacklist" and "whitelist" because they are the same to type and harder to pronounce aloud.

Whoever cooks up these schemes should have put more effort in. Even something like passlist and stoplist is easier to say. Throughlist. Something that sounds nice in a foreign language, maybe.

Re:America's first law regulating AI bias in hiring takes ef... by phatskat on Sunday July 09, 2023 @12:14PM (#36655753)
That’s all just a matter of preference though. I personally like how allowlist and blocklist sound, and they also immediately convey intention.

You may also be biased towards whitelist and blacklist if you’ve heard them your entire life - if you had grown up with allowlist and blocklist, can you say for certain that someone suddenly saying “we should use whitelist and blacklist” wouldn’t give you the same feeling of clunkiness?

Re:America's first law regulating AI bias in hiring takes ef... by flextheruler on Sunday July 09, 2023 @11:15AM (#36655131)
If we get rid of whitelist/blacklist then we should also make referring to a company being in the black or the red verboten as well.

Both terms of phrase have just as much racist connotation which is to say none.

Re:America's first law regulating AI bias in hiring takes ef... by flangola7 on Sunday July 09, 2023 @01:21PM (#36656441)
> If we get rid of whitelist/blacklist then we should also make referring to a company being in the black or the red verboten as well.

I seriously 100% agree.

Re:America's first law regulating AI bias in hiring takes ef... by AbolishLunacy on Sunday July 09, 2023 @11:18AM (#36655171)
There must be a white paper somewhere about why we should adopt this word...
Re:America's first law regulating AI bias in hiring takes ef... by jupp0r on Sunday July 09, 2023 @11:20AM (#36655191)
Like all the deny holes in the center of our galaxy ....
Re:America's first law regulating AI bias in hiring takes ef... by phatskat on Sunday July 09, 2023 @12:21PM (#36655815)
That’s a completely invalid counterpoint you’ve got there
Re:America's first law regulating AI bias in hiring takes ef... by jupp0r on Monday July 10, 2023 @03:26AM (#36663108)
That's a completely invalid counter counter point you've got there
Re:America's first law regulating AI bias in hiring takes ef... by AmericanChopper on Sunday July 09, 2023 @11:08AM (#36655073)
The correct technical jargon is actually whitelist, and the origin of the term has no racial connotations whatsoever.
Re:America's first law regulating AI bias in hiring takes ef... by bitwise-bouncer on Sunday July 09, 2023 @11:14AM (#36655125)
Granting that premise, consider that words do not exist in a vacuum. What pain is it to you to promote a more inclusive atmosphere?
Re:America's first law regulating AI bias in hiring takes ef... by beau_g on Sunday July 09, 2023 @11:26AM (#36655249)
Please edit your post to remove these words - Granting - starts with Grant, same name as a slave-owning US president Consider - starts with con, (con/ ex-con), used to shame and discriminate against people who have committed crimes but served their sentences Vacuum - often used with sexist connotations suggesting women should be the primary user of this tool as a means of housekeeping Pain - perceived differently by different populations, for instance redheads experience more pain than other hair colors Promote - likely to remind people of unfair corporate ladder practices Atmosphere - seen as a positive for earth dwellers, suggesting we are superior to planets which do not have atmospheres
Re:America's first law regulating AI bias in hiring takes ef... by bitwise-bouncer on Sunday July 09, 2023 @11:30AM (#36655287)
Thank you for your elucidation brother beau
Re:America's first law regulating AI bias in hiring takes ef... by DougN7 on Sunday July 09, 2023 @11:20AM (#36655194)
I like the term whitelist, but feel excluded by the pressure you are applying. This can go as deep as you want…
Re:America's first law regulating AI bias in hiring takes ef... by bitwise-bouncer on Sunday July 09, 2023 @11:33AM (#36655310)
Why do you like the term “whitelist”?
Re:America's first law regulating AI bias in hiring takes ef... by DougN7 on Friday July 14, 2023 @12:35PM (#36726321)
Does it matter? I also like it when my finances “are in the black” as opposed to “in the red”. I don’t know a ton of African Americans, but I have talked with some of them about this. Although they definitely experience racism, none of them feels terms like “whitelist” is exclusionary. This feels like seeking for reasons to be hurt. Same with “master” and “slave”. There is a lot of history of white slaves in Europe, but it doesn’t hurt my feelings even though my ancestry is from those nations.
Re:America's first law regulating AI bias in hiring takes ef... by jncfhnb on Sunday July 09, 2023 @11:18AM (#36655164)
I think it’s more inclusive to say whitelist and blacklist
Re:America's first law regulating AI bias in hiring takes ef... by AmericanChopper on Sunday July 09, 2023 @11:19AM (#36655183)
> consider that words do not exist in a vacuum

You’re right. They exist in the context in which they’re used. In this case that context is as a technical term that has no association at all to any racist ideas. I would advise you to consider that you do not exist in a vacuum, and perhaps you should reconsider your anti-social impulse to police other peoples’ use of innocent words. Forcing people to remove words from their vocabulary because they remind you of some upsetting concept is not inclusive at all. It is by definition exclusionary.

Re:America's first law regulating AI bias in hiring takes ef... by bitwise-bouncer on Sunday July 09, 2023 @11:29AM (#36655273)
The move to more neutral language isn't about policing speech. It's about being aware of potential unintentional biases our words may carry and promoting a comfortable, inclusive environment. It's a dialogue, not a mandate
Re:America's first law regulating AI bias in hiring takes ef... by blueflow on Sunday July 09, 2023 @11:35AM (#36655331)
Like naming the DPRK "democratic" making it more democratic? Or renaming the ministry of war to ministry of defense? Or naming the Ukraine invasion "special operation" instead of "war"?

Renaming things or describing them differently does not change them. As an adult citizen in a democratic country, you should be able to see through such manipulative moves.

I agree with the other posters making fun of your logic, because its arbitrary and can be used equally on your own writings.

Re:America's first law regulating AI bias in hiring takes ef... by AmericanChopper on Sunday July 09, 2023 @11:35AM (#36655332)
> My attempt to police your speech wasn’t about policing speech. It was about about creating a dialogue, and making sure you know that you are racist if you don’t agree with me, not mandating that you agree with me.

Haha, ok buddy.

If you want to be more inclusive, perhaps you could go to the effort of understanding the vocabulary of my trade and the meaning of those words, rather than try to prevent me from using them. Because I’m feeling very excluded by you right now. Do you care about the lived experience I’m having right now? If not, why?

Re:America's first law regulating AI bias in hiring takes ef... by bitwise-bouncer on Sunday July 09, 2023 @11:55AM (#36655559)
This isn't about policing or labeling anyone. It's about opening a dialogue for potentially more inclusive terms in our field. No intention to make you feel excluded, only to make room for discussion.
Re:America's first law regulating AI bias in hiring takes ef... by AmericanChopper on Sunday July 09, 2023 @07:25PM (#36660150)
This comment is really the height of gaslighting. These D&I topics have never been an open dialogue, and it’s never been the intention for them to be. Nobody who objects to a D&I project feels as though their input is welcome, and those who are fool enough to voice their objections invariably suffer the consequences for it. These “open dialogues” are about proposing a change, with the implication (or by just explicitly stating) that any objection to the change is racist/sexist/whatever… and would victimise minorities.

The term whitelist is a legitimate piece of technical jargon, and has no racist origin. That is the end of any reasonable discussion on this topic. If you wish to litigate that point any further, that only direction that could possibly take is into wildly unreasonable territory. Renaming anything that people may feel is associated with other problematic concepts has no finish line. There’s an infinite quantity of problems you could invent using this approach, and all of the would be completely equal in their unreasonableness. The only way you could potentially limit this scope is to elevate the unreasonable feelings of one group over the unreasonable feelings of all other groups. Which is an exclusionary practice, and goes to show how subversive the use of language like “inclusion” is here.

Re:America's first law regulating AI bias in hiring takes ef... by bitwise-bouncer on Monday July 10, 2023 @10:10AM (#36666715)
Ultimately, the immediate material impact of using term A or term B within a corporate environment is a piddling

While the direct impact of changing a term might seem insignificant, it's about mutual respect and understanding. This isn't language policing, but sparking awareness. Your feelings are valid, your input is welcome. Let's keep talking, even amidst disagreements. Progress lives in dialogue, not silence.

Re:America's first law regulating AI bias in hiring takes ef... by phatskat on Sunday July 09, 2023 @12:27PM (#36655866)
The words in context have no racist history, but consider a young black student interested in network engineering. They start learning that “good services go on the whitelist” and “bad services go on the blacklist”. I can see a potential for that to rub them the wrong way, and while it is a small thing they would likely shrug off, it may also get filed into the box of a million other things that they have to be aware of that are racist in meaning. It’s one more thing that could reinforce the ideals that systemic racism drives into their life.

A case could also be made for people who aren’t aware of the context: are they confused because the terms aren’t familiar? Does their own bias influence them to understand the meaning and infer white = good, black = bad? If so, is that not more reason to change the words? Shouldn’t we move away from language that associates good and bad with colors that are often used as tools of division?

Re:America's first law regulating AI bias in hiring takes ef... by meindnoch on Sunday July 09, 2023 @01:40PM (#36656729)
Do you seriously think black students would be that inept?
Re:America's first law regulating AI bias in hiring takes ef... by phatskat on Sunday July 09, 2023 @11:29PM (#36661724)
No, I’m saying brains - especially young brains - filter and see the world differently. They make assumptions or correlations that may not be accurate.

Regardless of who the audience is, the terms equate a color to either being good or bad and it’s kind of silly when terms like allowlist and blocklist are immediately parseable into what they mean.

I don’t particularly care other than if there’s some tiny segment who feels the terms could be even remotely offensive, and we can all agree that regardless there are better terms, why not use them?

Re:America's first law regulating AI bias in hiring takes ef... by zulban on Sunday July 09, 2023 @11:55AM (#36655567)
> whitelist acceptable input variables

A core lesson in ML: this is difficult or impossible. See the classic example with wolves, dogs, and snow. [1]

For a resume example, suppose you don't want to be biased again black candidates, or women. Well, good luck trying to filter out resume experience, skills, schools, and interests so that they don't list anything that is statistically more likely to be found among black folks or women. It's impossible.

So now you have a hiring process that looks at... what exactly?

[1] https://www.researchgate.net/figure/A-husky-on-the-left-is-c...

Re:America's first law regulating AI bias in hiring takes ef... by jncfhnb on Sunday July 09, 2023 @12:03PM (#36655646)
That is not the same problem. That’s a sample bias problem.

The whole point of white listing variables is to only allow things you are comfortable using todiscimrinate. And yes, that likely reduces the power of the model.

Edit: to clarify, your example had the model failing to classify something correctly because the training data did not generalize across real world examples. The problem with diversity bias is that the modes are trained on past data where the labels themselves tend to have some bias. Black candidates do worse. So recreatingthese will generally produce worse outcomes for minority candidates. Now for a lot of these cases the average minority individual is more likely to do worse. Not intrinsically because of race, but still worse.

You can’t realistically expect the model to produce equal outcomes for all classes when all classes are not equal on the actual traits. But you do want to try and make it so that the model doesn’t use race indicators as a crutch that ignores actual good indicators. The common complaint is you hear about a man and a woman applying with the exact same credentials but different outcomes. Well obviously the model had to have additional information besides those credentials if it made different decisions. If this causes problems, you probably should not permit those additional pieces of information.

Re:America's first law regulating AI bias in hiring takes ef... by parpfish on Sunday July 09, 2023 @01:42PM (#36656774)
> The whole point of white listing variables is to only allow things you are comfortable using todiscimrinate.

The problem is that variables where you can safely discriminate don't exist in the real world because everything is intertwined.

For example, if you see that somebody went to school at {Howard, Bryn Mawr, BYU} you can make some pretty solid inferences about their {race, gender, religion} even if they don't explicitly provide them.

Re:America's first law regulating AI bias in hiring takes ef... by pclmulqdq on Sunday July 09, 2023 @02:08PM (#36657122)
These schoools' associations are all correlations, not guarantees, though.

Howard is a historically black college, which means their student body today is majority black, not 100% black.

Bryn Mawr is a womens' school and admits only women. However, gender is not always fixed going through life.

BYU is a Christian school, but also admits several non-religious people too, and people regularly become apostates to their respective religion.

Re:America's first law regulating AI bias in hiring takes ef... by Wowfunhappy on Sunday July 09, 2023 @02:27PM (#36657366)
> Bryn Mawr is a womens' school and admits only women. However, gender is not always fixed going through life.

Technically true of course, but >99% of the population will identify with a single gender throughout their life. The correlation is so strong that it's not even really a correlation anymore.

Re:America's first law regulating AI bias in hiring takes ef... by pclmulqdq on Sunday July 09, 2023 @02:43PM (#36657539)
If you're going with a probabilistic argument, I think BYU students are more likely to stick with mormonism (let alone Christianity) than Bryn Mawr students with their gender.

That doesn't mean you aren't stereotyping people, though.

Re:America's first law regulating AI bias in hiring takes ef... by Wowfunhappy on Sunday July 09, 2023 @04:44PM (#36658689)
Irrespective of the AI discussion (computers don't care if you're stereotyping or not), I really don't think it's stereotyping to assume someone who went to a school which literally only admits women is probably a woman. There's a difference between assuming someone's gender because they're a cheerleader, and assuming because they won the women's cheerleading championship. I also assume that the person who drives a fire truck is a fire fighter.
Re:America's first law regulating AI bias in hiring takes ef... by michaelt on Sunday July 09, 2023 @02:45PM (#36657552)
Right, but the fact the associations are only correlations won't stop the ML model from learning them, if they're present in the training data.

If the training data shows a history of bias against Howard graduates, the model will learn to replicate.

Re:America's first law regulating AI bias in hiring takes ef... by jncfhnb on Sunday July 09, 2023 @02:58PM (#36657701)
No, again, it is inevitable that outcomes will not be equitable across race. That doesn’t mean all variables are unjustified to use.

Job applications are kind of dumb. The common use case is credit decisions. Surely, for example, you’re ok looking at credit history and income when deciding to make a loan, right? Even though it won’t be equitable outcomes across races, it is still “fair”

Re:America's first law regulating AI bias in hiring takes ef... by parpfish on Sunday July 09, 2023 @04:41PM (#36658665)
The goal of fairness ML models is not necessarily to have equal outcomes across subgroups.

Other goals can be to have equal model accuracy across subgroups (e.g., models has the same precision/auroc/etc for each subgroup, even if the predictions themselves differ across subgroups) or identical distribution of statistical biases across subgroups (e.g., the model makes the same types of mistakes within each subgroup)

Re:America's first law regulating AI bias in hiring takes ef... by jncfhnb on Sunday July 09, 2023 @07:13PM (#36660060)
While a lot of people will state those are appropriate goals, they are not. They’re really dumb goals. The model being equally bad for each group is not an indicator that you have achieved anything. Most likely you’ve just made your model for white people worse.

Like, let’s look at that for credit decisions. Black folks have a lower income distribution. So it’s like saying the model is ok if it rejects a Black applicant making 80k if it would also reject a White candidate making 100k. That is the insane bullshit you’re effectively supporting by desiring comparable error distributions.

You have to accept that equal outcomes are not just impossible but not desirable. And then you only use fields that people agree are fair to use. If Black people get disproportionately better or worse outcomes it is either because those outcomes make sense given their stats or it’s not ok because if a White dude had the same info, that you agree is fair to use, they would have passed and the underlying reason for the difference is some bullshit other input.

That might mean that the model is a dumb: you must make $100k for this loan (illustrative) which is going to mean a lot of Black folks cannot get it. Well that model is at least “fair”. Accommodations for race should not be coming from an AI model

Re:America's first law regulating AI bias in hiring takes ef... by parpfish on Sunday July 09, 2023 @11:01PM (#36661546)
Agree to disagree
Re:America's first law regulating AI bias in hiring takes ef... by jncfhnb on Monday July 10, 2023 @08:06PM (#36674829)
I would love to hear a counter argument that explains why having all models perform equally bad is desirable.
Re:America's first law regulating AI bias in hiring takes ef... by cudgy on Sunday July 09, 2023 @03:38PM (#36658081)
Why not simply target the advertising of the job at traditionally black universities, publications, and social networks? Why all the ai mumbo jumbo to filter resumes from a general marketing strategy?
Re:America's first law regulating AI bias in hiring takes ef... by mgraczyk on Sunday July 09, 2023 @03:16PM (#36657875)
Unfortunately this doesn't work, one of the basic things to know about ML fairness is that you generally can't get the outcomes you want by hiding things from your model.

For example you can infer the race of a candidate from other facts about them. The model could still illegally discriminate by first inferring race, then discriminating on the basis of inferred race.

Re:America's first law regulating AI bias in hiring takes ef... by jncfhnb on Saturday July 15, 2023 @08:05AM (#36735820)
Then those things shouldn’t be on the whitelist. That’s the point of a whitelist.

The problem you describe affects blacklists that try to remove only the things you obviously don’t want to use.

Re:America's first law regulating AI bias in hiring takes ef... by mgraczyk on Saturday July 15, 2023 @02:00PM (#36739410)
You will end up adding things to your whitelist that you think are innocuous, but if that's all you do you will very likely end up discriminating and not even knowing it.