News for hackers. Stuff that matters.
Re:Flawed Algorithms Are Grading Millions of Students’ Essays by Spivak on Thursday August 29, 2019 @08:18PM (#20834902)
It's amazing to see how the general opinion of CS people has completely shifted in the last few years from "algorithmic scoring is important in removing the bias from human graders" to the exact opposite.
Re:Flawed Algorithms Are Grading Millions of Students’ Essays by kazinator on Thursday August 29, 2019 @08:37PM (#20835005)
If we can quantify the bias in the machine, that gives us an opportunity to close the feedback loop and control the bias.

The bias comes from the human-generated training data in the first place; the machine isn't introducing its own. For instance, the machine has no inherent concept of disparaging someone's language because it's from an identifiable inner city dialect. If it picks up that bias, at least it will apply it consistently. When we investigate the machine, the machine will not know that it's being investigated and will not try to conceal its bias from us.

On the other hand, eliminating bias from humans basically means this: producing a new litter of small humans and teaching them better than their predecessors.

Re:Flawed Algorithms Are Grading Millions of Students’ Essays by gibolt on Friday August 30, 2019 @11:34AM (#20839589)
If...
Re:Flawed Algorithms Are Grading Millions of Students’ Essays by Larrikin on Thursday August 29, 2019 @08:30PM (#20834970)
That was the hope, but all the most effective methods suffer from data collection bias and the studies show that makes them worst than implicitly biased humans.
Re:Flawed Algorithms Are Grading Millions of Students’ Essays by peteradio on Thursday August 29, 2019 @08:37PM (#20835006)
It is important but its not ready.