Re:There’s No Such Thing As ‘Ethical A.I.’
by SpicyLemonZest on Sunday May 17, 2020 @03:42AM
(#23210404)
Your core idea is true, but such analyses are typically not done because the answer isn't considered relevant. An advocate would argue that the concept of "abusive" is culturally relative, so we must draw the line of abusiveness in a way that avoids disparate impact.
> The results show evidence of systematic racial bias in all datasets, as classifiers trained on them tend to predict that tweets written in African-American English are abusive at substantially higher rates.
Wouldn't we need to know the true rate of abusive tweets by race in order to conclude this? Is this addressed at all, e.g. with human labelled data, or am I mistaken in thinking this is necessary?