You need to look at it in the context of a long[1] list[2] of works[3] detailing this exact problem, and the frustration that an leading expert in the field still doesn't take it seriously, despite the real-world consequences of that attitude.
1) https://www.pnas.org/content/117/14/7684
2) http://proceedings.mlr.press/v81/buolamwini18a.html?mod=arti...
3) https://www.liebertpub.com/doi/full/10.1089/big.2016.0047
If you want to talk about statistical methods being a horrible idea for policing, I'm with you. Probably most machine learning experts would be, too, just like most software engineers don't trust electronic voting. Instead, people chose "dataset bias affects machine learning models", the most basic Machine Learning 101 fact ever, to try and debate against.
It's like the woke people seek out the weakest possible ground because it generates in-group opposition that they can fight with and out-woke. Stronger ground could have national consensus, way beyond bay area consensus.
Does that negate the truthfulness of LeCun's response? What would Gebru rather he do or say?
I feel like I can't tell what the desired form of action is from the article, and I'm unsure what good it does for removing bias from ML to attack prominent figures (on twitter let alone anywhere public).
No one disagrees with that statement. The point that the ethicists are making is that that isn't the whole story, and that focusing only on the lowest hanging fruit (dataset bias) is ultimately harmful since it shifts focus away from the other, deeper problems.
I'm not sure I understand what the issue is at all.
1. Responded with a detailed summary of his views.
2. Said he was open to changing his mind in the face of convincing arguments; indicated a desire to learn.
3. Asked people to stop attacking his opponent, in response to unfair attacks on her.
4. Only a week ago, sent multiple tweets out about the problems with a paper which demonstrated racial bias. https://medium.com/@CoalitionForCriticalTechnology/abolish-t...
There's something in between not taking someone seriously and agreeing with their argument.
All of the same concerns are discussed in their works about representational data and biased algorithms etc...
The idea that this concept, one almost as old as computers and practically a theorem of computation, would somehow be racist or trying to paper over racism is ridiculous.
> On two occasions I have been asked, 'Pray, Mr. Babbage, if you put into the machine wrong figures, will the right answers come out?' I am not able rightly to apprehend the kind of confusion of ideas that could provoke such a question.
I couldn’t tell you when the discussion about bias and unreliability in ML training sets started, not my field of expertise.
But I do think that when someone who is white (or another race) says "here's a cool thing, check it out" and someone who is black (or another race, different from the first) tries it and realizes it doesn't work for them because of their race, there is a bit of inadvertent racism there. There is an inadvertent exclusion of that second person. I think this happens a lot and in some cases is unavoidable (e.g. language is intertwined with race, and there is a vast amount of information—literature, news, art—that will be inaccessible to you depending on which language(s) you speak), but it is a problem, and it deserves fixing when possible.
The implications in this case are currently small—it's a demo. But there is a risk that these biases could make it into real systems and have real impact on people's lives, and to combat that we need more awareness of this effect in the ML community and more research into possible solutions.
Someone (who by the way describes themselves more as an artist than anything else in public bios) builds a ML "bullshit artist" (literally) that hallucinates portraits from ridiculously undersampled data. Someone else runs a low resolution image of Obama through a hallucinating computer program, and gets a hallucination.
The story should end here at "these hallucinated portraits have basically nothing to do with the input data, they're meaningless". I would bet that input images that are this low resolution are difficult or impossible to determine the race of, no matter how diverse the training data for this model could have been. Note that the skin color of the low resolution Obama and the random "white" guy it generated are basically the same!? I doubt this pipeline will ever be capable of not confusing the race of its input and output.
What is on display here is the uselessness of this ML pipeline, not its racist nature. I have seen probably a dozen of examples of this ML pipeline failing hilariously in ways that have nothing to do with race. Yet this failure is suddenly fascinating to the entire tech journalism space as an example of ML algorithms being racist?!
And somehow, despite the absurdity of this situation, even ML "luminaries" get drawn into a destructive whirlpool of social justice debate about a hallucinating computer program that doesn't even work sometimes? What the fuck are we all doing here?