News for hackers. Stuff that matters.
Re:Minority voices ‘filtered’ out of Google Natural Language... by sdenton4 on Friday September 24, 2021 @11:40AM (#28643906)
‘Some filters are relatively straightforward, such as removing Lorem ipsum placeholder text. However, we find that another filter which removes documents that contain a token from a banned word list, disproportionately removes documents in dialects of English associated with minority identities (e.g., text in African American English, text discussing LGBTQ+ identities).’

A word so lovely that we really really don't want to risk putting it in our report...

Re:Minority voices ‘filtered’ out of Google Natural Language... by SpicyLemonZest on Friday September 24, 2021 @11:51AM (#28644065)
Yeah, I have similar concerns about the different dialects thing. It's true that "the meaning of seemingly 'bad' words heavily depends on the social context", but most realistic systems are gonna be deployed in multiple social contexts and ideally shouldn't be offensive in any of them.
Re:Minority voices ‘filtered’ out of Google Natural Language... by beerandt on Friday September 24, 2021 @01:28PM (#28645405)
It's not that there are different contexts, it's that with particular identity groups, the "rules" for that context vary so much over time (and context) as well.

For most of the 90's saying black was "wrong" in favor of African American. Now we've gone full circle, and the same people who made a sour-face at black 25 years ago are capitalizing it.

That's probably the most benign, easy case. Of course ML can't keep up with loaded-terms and slurs; most people can hardly keep track of it all.

Re:Minority voices ‘filtered’ out of Google Natural Language... by truffdog on Friday September 24, 2021 @11:48AM (#28644031)
If they didn't filter those words out, then presumably the headline would be about 'perpetuating' instead of about 'filtering'.
Re:Minority voices ‘filtered’ out of Google Natural Language... by meragrin_ on Friday September 24, 2021 @12:07PM (#28644293)
> A word so lovely that we really really don't want to risk putting it in our report...

I can't tell if that is sarcasm or not. Is the 'lovely word' disclosed somewhere else?