News for hackers. Stuff that matters.
Re:AI researcher Timnit Gebru resigns from Google by IfOnlyYouKnew on Thursday December 03, 2020 @02:05PM (#25293037)
I find it strange to take issue with the "I'm so tired" line. It would seem to be entirely appropriate for circumstances where you see an argument that you have replied to many times but that completely ignores your reply. It also just doesn't strike me as particularly hostile or profane. Quitting twitter and making a show of it strikes me as a far more emotional reaction, but nobody here seems to take any issue with that?

In this case, the issue is that "it's the dataset" is attacking a straw man: nobody is accusing ML practitioners to be explicit racists actively conspiring for their models to be racially biased. Everyone understands that it is (often) a result of the underlying dataset.

But, the argument goes, understanding the genesis of such bias isn't enough to excuse it. At least not when those models are put to actual use in, say, law-enforcement contexts. Or credit agencies, or hiring decisions, or really anything.

If your dog happened to bite any red-haired kid it came across, it doesn't matter that you think red-haired kids are just as good as others, or that the dog was once mistreated by a red-haired kid. You're not going to allow the dog to get near any red-haired kids. And if you do, you'll face charges of at least negligence when some red-haired kid gets mauled.

To tie this back to AI, it would mean that as long as your models produce racially biased results, they simply aren't ready for deployment or publication. Go find better data until your work is no longer liable to inflict harm on anybody.

That's the standard for all other industries: if your car is shown to reliably kill pedestrians below a certain height in crash tests, you go back to the drawing board. Adding a sticker "don't operate car in the vicinity of children" isn't enough.

You can disagree with that reasoning (although you'd be wrong). What you can't do, as a leader in AI, is to pretend to have never heard of it, or that it is so obviously wrong that it warrants no reply whatsoever.

> have to call out the "I'm so tired" bit every time I see it.

so... I guess you're tired of it?

Re:AI researcher Timnit Gebru resigns from Google by prionassembly on Thursday December 03, 2020 @02:36PM (#25293507)
> so... I guess you're tired of it?

I'm not.

Many other rhetorical moves have a lot of politics to muddle through / implicit assumptions that can be disavowed in bad faith, etc. I don't like to engage in that kind of discussion at all.

But the "I'm so tired" bit is both condescending (and it takes... something... to condescend to Yan LeCunn) and evasive. The end result is authoritarian -- look man, this is decided and settled, you haven't kept up.

Calling this out is interesting because it evidences on the contrary that the discussion isn't settled at all, and that she's unable or unwilling to frame it in a convivial manner that's conducive to progress.

I sit out of conversations I'm tired about.

Re:AI researcher Timnit Gebru resigns from Google by adamsea on Thursday December 03, 2020 @04:32PM (#25295375)
> Many other rhetorical moves have a lot of politics to muddle through / implicit assumptions that can be disavowed in bad faith, etc. I don't like to engage in that kind of discussion at all.

But isn’t what you described so vague and subjective, that you can apply it to pretty much anything?

IMHO it’s more honest to say “I sit out of conversations I don’t like”, which is an entirely fair and understandable decision to make :).

Re:AI researcher Timnit Gebru resigns from Google by prionassembly on Thursday December 03, 2020 @04:57PM (#25295753)
It’s hard to like something that makes you tired when it’s not one of your kids.
Re:AI researcher Timnit Gebru resigns from Google by gaze on Thursday December 03, 2020 @04:36PM (#25295427)
Yann was (actively or unintentionally) refusing to participate in the same conversation. His response was the "facts don't care about feelings" one. It's not wrong but it is a thought terminating cliche.
Re:AI researcher Timnit Gebru resigns from Google by prionassembly on Thursday December 03, 2020 @04:56PM (#25295729)
It is. Yann also seems blissfully unaware of how sampling bias issues have always been dealt with (eg the Heckman correction model) in traditional statistics, where “getting more data” is not an option.
Re:AI researcher Timnit Gebru resigns from Google by nwallin on Thursday December 03, 2020 @08:15PM (#25297801)
It's not the message, it's the tone. There's a big difference between offering constructive criticism and being a condescending prick.

> You can disagree with that reasoning (although you'd be wrong). What you can't do, as a leader in AI, is to pretend to have never heard of it, or that it is so obviously wrong that it warrants no reply whatsoever.

There's a third option. You can just decide to not engage with the condescending prick at all.

We have one of those at work. His area of responsibility is a very cross functional one, and while it is important, he have a great deal of difficulty getting people to participate. Because participation usually means getting told you're an idiot. Loudly, forcefully, and with more words.

That seems to be the case here, only substituting "idiot" out for "racist".

Re:AI researcher Timnit Gebru resigns from Google by IfOnlyYouKnew on Thursday December 03, 2020 @10:12PM (#25298475)
Re:AI researcher Timnit Gebru resigns from Google by kspacewalk2 on Friday December 04, 2020 @02:29PM (#25306580)
Yes, tone matters, regardless of your gender. A prerequisite for a mature adult conversation is for you to quit being hostile to me from the get-go.

Am I saying something controversial or micro-aggressive here? So be it.

Re:AI researcher Timnit Gebru resigns from Google by prionassembly on Friday December 04, 2020 @02:57PM (#25306951)
Then, this is a confrontational tone too.

I have the distinct impression that what they want is for discussions to become personal. Don't let them get to you.

Re:AI researcher Timnit Gebru resigns from Google by yamrzou on Thursday December 03, 2020 @03:52PM (#25294712)
> To tie this back to AI, it would mean that as long as your models produce racially biased results, they simply aren't ready for deployment or publication. Go find better data until your work is no longer liable to inflict harm on anybody.

Well, the disagreement is about publication. Yann LeCun himself said that "The consequences of bias are considerably more dire in a deployed product than in an academic paper."[1]

Why would it be wrong to publish research based on biased data?

[1] https://twitter.com/ylecun/status/1274790777516961792

Re:AI researcher Timnit Gebru resigns from Google by rubatuga on Thursday December 03, 2020 @03:57PM (#25294803)
What Yann said about data bias is a fact. He wasn’t dismissing your concerns nor distracting from it. A lot of people tried to extrapolate what Yann meant, but from the way I see it, if more people learn about the cause of this racial bias, the more people will be inclined to use fairer and diverse datasets in their future ML research.
Re:AI researcher Timnit Gebru resigns from Google by je42 on Thursday December 03, 2020 @04:32PM (#25295374)
The point is that she has an expectation of Yann to go further than just stating a fact.

I assume she thinks that Yann has enough intellectual capacity to improve situation of biased ML but doesnt execute. Further, my guess is that the reason why he doesnt execute is not transparent to her, hence frustrating.

Re:AI researcher Timnit Gebru resigns from Google by PeterisP on Thursday December 03, 2020 @07:18PM (#25297399)
This is probably the core of the conflict there - there are researchers that aim to remove technical bias from technical systems and expect to stop there, not going into social issues of how the systems will be applied, as they consider that (e.g. solving the biases in the society) as a separate issue.

Dr. Gebru, among others, expects and insists that they do go beyond that and try to get involved in the social consequences of tech. They refuse, ergo conflict.

Re:AI researcher Timnit Gebru resigns from Google by itsoktocry on Thursday December 03, 2020 @08:25PM (#25297883)
>I assume she thinks that Yann has enough intellectual capacity to improve situation of biased ML but doesnt execute.

Yann has no obligation to do so on Twitter, and shouldn't be called out by coworkers publicly regarding that decision, in my opinion.

Re:AI researcher Timnit Gebru resigns from Google by visarga on Saturday December 05, 2020 @12:39PM (#25316445)
> The point is that she has an expectation of Yann to go further than just stating a fact.

Yann was talking about a specific model, she was talking about ML & society on a grand scale. Can't we talk about specific things now? Why did he have to apologize for it?

My feeling is that Timnit is using people, she guilt trips, humiliates them online, makes a big fuss and it's all to whip up support in her crusades. She wants to win the public opinion by any means, so she needs famous opponents to pile on, such as Yann and Dean (who have universal admiration in the field). She's always playing the victim. I find this kind of behavior toxic, it degrades dialogue.

Re:AI researcher Timnit Gebru resigns from Google by prionassembly on Thursday December 03, 2020 @05:04PM (#25295819)
One of Jenny Holzer’s truisms is: you owe the world, not the other way around.

Isn’t Gebru an “AI researcher”, after all?

Re:AI researcher Timnit Gebru resigns from Google by TheMagicHorsey on Thursday December 03, 2020 @04:59PM (#25295771)
I don't think that's what she meant. You are filling in the blanks that she should have filled herself.
Re:AI researcher Timnit Gebru resigns from Google by rubatuga on Thursday December 03, 2020 @04:42PM (#25295534)
Although that is a bit overreaching of an expectation in my opinion, I agree it would be good if Yann was a bit more explicit.
Re:AI researcher Timnit Gebru resigns from Google by IfOnlyYouKnew on Friday December 04, 2020 @01:20PM (#25305789)
"It's December" is also a fact. He chose to mention a different one. Why, if not as an explanation / excuse for the model's behaviour?

Every practitioner already knows that these models behave according to the data they are trained on. The general public has no use for this explanation because they aren't the one deciding on the training data. So the only practical purpose is to offer some superficial causal mechanism that sounds like an explanation to that public, presented as an unchanging fact of nature, and distract from the equally true fact a biased model is only published or used iff it is trained on biased data and someone decides to go ahead and publish/use it nonetheless.

Re:AI researcher Timnit Gebru resigns from Google by kspacewalk2 on Friday December 04, 2020 @02:31PM (#25306608)
What does that mean? What is an AI researcher to do differently? Put their academic life on pause and wait for more unbiased data?
Re:AI researcher Timnit Gebru resigns from Google by visarga on Saturday December 05, 2020 @12:07PM (#25316122)
You're making a fallacy here, forcing the issue into black and white - if you mention first 'dataset bias', it must mean you 'offer some superficial causal mechanism that sounds like an explanation to that public'
Re:AI researcher Timnit Gebru resigns from Google by matthewdgreen on Thursday December 03, 2020 @02:39PM (#25293573)
This post is a really good explanation, and I wish it had been in that Twitter thread.
Re:AI researcher Timnit Gebru resigns from Google by jeffxtreme on Thursday December 03, 2020 @04:18PM (#25295126)
The comment by the first John in the comment of the article here [https://syncedreview.com/2020/06/30/yann-lecun-quits-twitter...] adds a lot of insight too (starting with "As I understand, the social and structural problems are that AI learns the social and structural biases that are already present.").
Re:AI researcher Timnit Gebru resigns from Google by uoaei on Thursday December 03, 2020 @02:30PM (#25293434)
> so... I guess you're tired of it?

Yeah GP is modeling exactly the behavior they're railing against. Claiming that something is wrong without any practical insights for how that thing might be better.

Re:AI researcher Timnit Gebru resigns from Google by visarga on Sunday December 06, 2020 @01:31AM (#25321616)
It's not exactly the same behavior - it's along the lines of "can't tolerate intolerance" (meta).
Re:AI researcher Timnit Gebru resigns from Google by visarga on Sunday December 06, 2020 @01:27AM (#25321591)
> "I'm so tired"

Tiredness is probably coming from trying to educate people on Twitter, you can't do that because tomorrow a fresh batch will come and you have to start over.

Re:AI researcher Timnit Gebru resigns from Google by njanirudh on Thursday December 03, 2020 @11:01PM (#25298741)
You shouldn't be tired of telling someone about a cutting edge subject that you are an " expert" of.