Re:Minority voices ‘filtered’ out of Google Natural Language...
by cyanydeez on Friday September 24, 2021 @07:43PM
(#28649013)
actually, if your goal is "handle 99.9% of circumstances", your job is to find the edge cases and make sure they are as normal as all other cases.
thats not whats happening in ML. whats happening is "find the easiest amount of information to train a model"
Like, it's not like this filtering was done for the purpose of silencing anyone — Google (among others) really learned the hard way to not feed smut to ML models, as it _will_ get regurgitated, always as a possible PR disaster in the making:
https://www.buzzfeed.com/fionarutherford/heres-why-some-peop...
https://www.huffpost.com/entry/microsoft-tay-racist-tweets_n...
Still interesting research, but playing the devil's advocate, I think I can see why this part of the corpus was more extensively filtered away.
Sad issue, but I don't think we'd have a sane way out without massive, manual whitelisting.