Re:Flawed Algorithms Are Grading Millions of Students’ Essays
by kazinator on Thursday August 29, 2019 @09:18PM
(#20835194)
> but claims that AI bias is somehow worse than good old human bias always seem shoddily supported
Well, AI bias can combine sampling bias with human bias. Like say we train the AI with the output of only 10 human paper graders, all chosen from the same school district.
Due to the sampling bias, that data could create markedly more (or less!) bias than the entire population of human paper-graders.
The resulting AI will ideally mimic those 10 humans, though; it shouldn't show more bias than that group. If those 10 are flaring racists, and grade accordingly, the AI will be the same. (In fact, we hope that it will be the same, if the algorithm actually works in mimicking human grading.)
Well, AI bias can combine sampling bias with human bias. Like say we train the AI with the output of only 10 human paper graders, all chosen from the same school district.
Due to the sampling bias, that data could create markedly more (or less!) bias than the entire population of human paper-graders.
The resulting AI will ideally mimic those 10 humans, though; it shouldn't show more bias than that group. If those 10 are flaring racists, and grade accordingly, the AI will be the same. (In fact, we hope that it will be the same, if the algorithm actually works in mimicking human grading.)