News for hackers. Stuff that matters.
Re:Tensions in Google's ethical AI group increase as it send... by fatbird on Thursday December 17, 2020 @01:51AM (#25453291)
Because the academic standard for research, and the original motivation for tenure, allows for researchers to criticize anyone, including their own institution, as long as it's done and presented as the proper product of research. In other words, if a researcher is doing their research properly, it shouldn't matter if they're attacking their own institution or even colleagues, because it passes scientific muster and the quality of the research is what justifies it.

When companies like Google or IBM employee researchers, they're positioning themselves as supporting that model of inquiry, and the benefit for them is the credibility that comes from participation in scientific inquiry. Gebru attacking Google's AI practices actually lends Google credibility for disinterestedly supporting basic research and taking its results seriously.

A company that employs an ethicist and takes that ethicist's output seriously even when it challenges the company is a company that genuinely cares about the academic standard in that field. A company that hires an ethicist and then fires them when they point out the company's wrongdoing is sounding an alarm about their own unethical conduct.

The part I struggle to understand here is how Google could be so stupid. Who cares, from a commercial perspective, if an academic they employ drags them? Keeping Gebru on payroll was straightforwardly purchased ethical credibility; firing her is a PR disaster and an open statement that their ethics AI group is a propaganda unit rather than a genuine research entity. It would have been trivial, even beneficial, to air the academic dispute. They gained nothing by retracting her paper and then firing her.

Re:Tensions in Google's ethical AI group increase as it send... by tootie on Thursday December 17, 2020 @09:13AM (#25455703)
This is it exactly. She's applying a standard of academic rigor to Google and they can either accept it or not. If they want to filter what kind of research they publish, then they have to admit to themselves (and their employees) that they baking pro-Google bias into their work and it need not be taken too seriously by academics. Maybe that kind of bias is irrelevant when you're publishing algorithm or mathematical work where bias is less inherent, but if you have an AI Ethics team you should be prepared for some controversy. And they clearly weren't and panicked.
Re:Tensions in Google's ethical AI group increase as it send... by atsjie on Thursday December 17, 2020 @07:40AM (#25455024)
"Timnit Gebru: Google and big tech are 'institutionally racist'"

https://www.bbc.com/news/technology-55281862

It's good to be critical and reflect on the company you're working for. There are bad cultures and attitudes in any big company, not just tech.

But if you're going to sprout your opinions publically about your (ex)-employer like that, sorry, but I wouldn't want her in my team. She sounds like too much of a headache to deal with. Her work must be truly extraordinary to warrent having that headache.

Re:Tensions in Google's ethical AI group increase as it send... by nullifidian on Thursday December 17, 2020 @09:43AM (#25455979)
>Her work must be truly extraordinary

I'm pretty sure her work as an ethicist can be summarized as "Any application of AI/ML must be stopped until it is absolutely GUARANTEED that there won't be anything that could be deemed discriminatory by proponents of critical race/gender theory." Which is obviously an untenable position for a tech company.

I think she will be happy when we develop natural language understanding to the degree where we could implement an automatic critical theory censor, that would check for undesirable biases.

Re:Tensions in Google's ethical AI group increase as it send... by cbozeman on Thursday December 17, 2020 @11:13AM (#25456892)
> when we develop natural language understanding to the degree where we could implement an automatic critical theory censor, that would check for undesirable biases.

That sounds like more of a nightmare scenario than having to deal with this person... Its hard to even know where to begin with how something like this could go off the rails easily.

Re:Tensions in Google's ethical AI group increase as it send... by fatbird on Thursday December 17, 2020 @11:18AM (#25456942)
Indeed. Imagine how people of color feel at the possibility of an AI running ever-larger parts of society that has racism built right into it at the start because the people building it are blind to anything but the most obvious instances of it.
Re:Tensions in Google's ethical AI group increase as it send... by cbozeman on Thursday December 17, 2020 @11:41AM (#25457195)
Like entirely too many people, you're confusing "racism" with "prejudice". They're not the same thing.

Actual racism is very rare in America. Prejudice is commonplace and has a lot more to do with the inherent tribalism of humanity than it does actual malice for someone's "race". And to take it even further, I think if people were honest, what they really dislike is cultural differences that vary dramatically from theirs.

To me this is just like trans issues... we'll never get anywhere significant with this stuff, because in order to come up with meaningful answers, you have to ask meaningful, hard questions. No one wants to ask these kinds of questions, because no one wants to have to deal with the answers that may come up, because that will also invite further study and further difficult, unpleasant conversations.

Re:Tensions in Google's ethical AI group increase as it send... by adamsea on Thursday December 17, 2020 @10:04AM (#25456154)
> She sounds like too much of a headache to deal with.

Yeah and your average software engineer is roses.

Difference is engineers positively impact the bottom line and society is less tolerant (empirically researched fact) of pushback from women or people of color.

For sure there may be complications on both sides of this issue but let’s not pretend that this shit isn’t real.

Re:Tensions in Google's ethical AI group increase as it send... by tootie on Thursday December 17, 2020 @09:10AM (#25455678)
I wouldn't want to run a racist company. And I wouldn't want to create phony pretense for firing someone if there was ostensibly valid justification they could have used.
Re:Tensions in Google's ethical AI group increase as it send... by tomcam on Thursday December 17, 2020 @04:41AM (#25454064)
You’re 100% right. A job at a FAANG company isn’t a tenured position. Let her go get a job at Harvard and trash them all she wants.
Re:Tensions in Google's ethical AI group increase as it send... by fatbird on Thursday December 17, 2020 @10:10AM (#25456215)
I think you're missing the point: companies like Google set up research units like this to act like tenured positions, like mini-universities, and then employ academics like Gebru just so they get the credibility that comes with employing them. "See, we're not all about profit, we support basic research in this area, even when it criticizes our other work."

Critical to that credibility is actually having the same standards as Harvard with respect to allowing the researchers to publish what they will, whether or not they're the target. By appearing to fire Gebru because her paper was insufficiently pro-Google, they damaged their whole purpose of having an ethical AI group.

The demands of the group may seem childish or absurdly far-reaching, but if Google wants to rebuild their credibility here, this is the standard they have to hit. Otherwise, their own researchers have less credibility because their output will be viewed as "approved by Google management", not real research. This is critical if they need to say "our own AI ethicists say this is ok."

[dead]
Re:Tensions in Google's ethical AI group increase as it send... by cbozeman on Thursday December 17, 2020 @11:24AM (#25457000)
You'd be hard-pressed to find an ethical issue with how Edward Snowden handled the revelation of mass illegal spying on the American people.

And I don't think anyone's disputing her desire to promote and encourage ethical implementations of AI technology. The crux of this issue is how you handle yourself, and it seems the more I read about how she handled these things, the more it seems like how children act.

"If I don't get my way, I'm quitting!"

Yeah, you get to sit atop your high horse and lord your morality over the rest of the mortals beneath you. You don't actually get to do shit, though, and you've actively lost the ability to control how this unfolds, at least at Google.

Re:Tensions in Google's ethical AI group increase as it send... by ntsplnkv2 on Thursday December 17, 2020 @11:46AM (#25457257)
Again, if that were the case, there wouldn't be "tensions in google's ethical AI group."

They're clearly unhappy, and so are many google employees. This clearly isn't just one person, this clearly is bigger than that.

> You'd be hard-pressed to find an ethical issue with how Edward Snowden handled the revelation of mass illegal spying on the American people.

What ethical issue is there with the revelation of problems in the ethical AI division of google? You just "don't like how they act." I've heard many people say the same of individuals on street corners...not a great look.

Re:Tensions in Google's ethical AI group increase as it send... by cbozeman on Thursday December 17, 2020 @12:09PM (#25457520)
The problem, as I stated in another comment, is that these people don't really understand what their job is and that's causing this confusion.

Their job is to build a bulwark for the company to guard it against negative press, and that will allow Google to create an AI that leverages all its data and currently existing infrastructure to increase shareholder value. They actually think their job is to prevent bad things from happening. Its not, and that's where the confusion is occurring. That confusion is turning into frustration, which in turn becomes anger.

You'll probably say something like, "Well that's a cynical viewpoint..."

Any company's "Ethics" committee/board is there to do that. Just like Human Resources is there to protect the company from you, not you from the company.

The only problem is that entirely too many Googlers think they're actually employed to make the world a better place. They're employed to create shareholder value. Sometimes making the world a better place will align with increasing shareholder value. Sometimes it won't.

Re:Tensions in Google's ethical AI group increase as it send... by ntsplnkv2 on Thursday December 17, 2020 @03:29PM (#25459972)
And Snowden's job was to keep the US government's spy systems working. So what?

Just because it's their "job" doesn't make it right or not worthy of whistleblowing.

If companies are doing bad things we want whistleblowers to tell us. I just don't understand your argument - "you can do bad things if it's your job." No. It doesn't work that way.

Re:Tensions in Google's ethical AI group increase as it send... by cbozeman on Thursday December 17, 2020 @08:20PM (#25462697)
Yes, you can do bad things if its your job.

You can't do illegal things. Difference.

Re:Tensions in Google's ethical AI group increase as it send... by ntsplnkv2 on Thursday December 17, 2020 @10:55PM (#25463639)
If your point was to be purposefully obtuse and present a strawman, why bother?

Either way if we didn't have whistleblowers for very bad things that weren't illegal, we would never make laws to make them as such.

Re:Tensions in Google's ethical AI group increase as it send... by tiahura on Thursday December 17, 2020 @04:12PM (#25460493)
> You'd be hard-pressed to find an ethical issue with how Edward Snowden handled the revelation of mass illegal spying on the American people.

Did he contact any of the number of Congressmen or Senators who are sympathetic to his concerns to see what could be done before committing treason?

Re:Tensions in Google's ethical AI group increase as it send... by Tenoke on Thursday December 17, 2020 @10:13AM (#25456258)
>Yet when a woman of color does it

Maybe the reason it isn't praised in this case isn't due to her being a woman of color but due to other differences in this case and those that are praised?

Re:Tensions in Google's ethical AI group increase as it send... by ntsplnkv2 on Thursday December 17, 2020 @11:01AM (#25456753)
If that were the case there wouldn't be "Tensions in Google's ethical AI group" would there be? Read the article, clearly the team, and many Google employees, were angered by this.

Perhaps we shouldn't just sweep it under the rug. It seems there is very real merit, this was not just a disgruntled employee. The subject matter is directly related to diversity - to remove race is to, again, cover up the systemic race issues we face as a society.

Re:Tensions in Google's ethical AI group increase as it send... by throwaway19937 on Thursday December 17, 2020 @12:17PM (#25457624)
> We praise whistleblowers left and right on HN, at the expense of objectivity (assange, snowden, et al), despite ethical issues with them.

HN has a large audience with a broad range of opinions. In my opinion, Snowden and Manning are traitors and the latter should have been left in prison.

> Had a white male done this, it's hard not to think he'd be praised as a hero on here.

I'd be equally dismissive of any person who committed the following actions.

1. Griping about the racist reviewers of her paper on Twitter.

2. Sending an email to a internal list criticizing Google's behavior and telling people to stop working on diversity.

3. Demanding the names of reviewers and threatening to resign if they weren't provided.

Re:Tensions in Google's ethical AI group increase as it send... by ntsplnkv2 on Thursday December 17, 2020 @03:36PM (#25460058)
> HN has a large audience with a broad range of opinions. In my opinion, Snowden and Manning are traitors and the latter should have been left in prison.

Just like any large audience a hive mind exists. There are more posts in favor of Snowden/Assange on here than in favor of this google employee. In general, more come to their defense, than hers, despite doing similar things.

Those aren't why you're dismissive. You've made up your mind on her, and make those items "dismissive" to support your POV, because you can't actually prove one way or the other. Perhaps some of the reviewers are racist. We've seen in the past 4 years that racism is alive and well in this country.

I don't see a problem with sending an internal email to colleagues. Should everyone just fall in line and do everything asked ever and never want change?

If she is publicly publishing a paper, reviewers should publicly publish their reviews, especially if they're negative. At this point, if we don't know the reviewers, we can't tell if they're genuine reviews, or not.

Re:Tensions in Google's ethical AI group increase as it send... by throwaway19937 on Friday December 18, 2020 @08:51AM (#25467027)
> Just like any large audience a hive mind exists. There are more posts in favor of Snowden/Assange on here than in favor of this google employee. In general, more come to their defense, than hers, despite doing similar things.

These cases are completely different.

Snowden and Assange exposed a global surveillance network that many are opposed to. I think of Snowden as the Kim Philby of the 21st century but that's a different discussion.

Dr. Gebu disagreed with the peer reviews of a paper, threatened to resign, and Google accepted her resignation.

> Those aren't why you're dismissive. You've made up your mind on her, and make those items "dismissive" to support your POV, because you can't actually prove one way or the other. Perhaps some of the reviewers are racist. We've seen in the past 4 years that racism is alive and well in this country.

She may feel that her paper was rejected because the reviewers are racist; I think it's more likely that they disagreed with the quality of the work. There was probably an administrative screw-up with its submission, though.

Neither of us can prove anything. It's unlikely that all the facts will come out in any event; Google would settle the case if it went to court.

> I don't see a problem with sending an internal email to colleagues. Should everyone just fall in line and do everything asked ever and never want change?

Have you read the email (https://www.platformer.news/p/the-withering-email-that-got-a...) that she sent? Would you expect to keep your job if you sent a similar email at work? Diversity is the third rail of modern companies - criticize or discourage it and you're gone.

> If she is publicly publishing a paper, reviewers should publicly publish their reviews, especially if they're negative. At this point, if we don't know the reviewers, we can't tell if they're genuine reviews, or not.

Anonymous peer reviews are a standard practice in industry and academia. If you demand the names of reviewers and threaten to resign if they aren't provided then don't be surprised if your employment ends.

Re:Tensions in Google's ethical AI group increase as it send... by free_rms on Thursday December 17, 2020 @10:45AM (#25456575)
What was she blowing the whistle on specifically? Carbon emissions from a company that's been "carbon neutral" on paper for a decade?
[dead]
Re:Tensions in Google's ethical AI group increase as it send... by cbozeman on Thursday December 17, 2020 @11:18AM (#25456941)
From what I understand, they didn't fire her, they accepted her resignation?

When you append, "Or I will leave" to a request and the company isn't interested in your request, you're resigning. You can dress it up in fancy language, but that's the bottom line.

Or did I miss something about this story?

Re:Tensions in Google's ethical AI group increase as it send... by pseudalopex on Thursday December 17, 2020 @06:06PM (#25461703)
She proposed working on a date. Google terminated her employment immediately and said it was for misconduct.[1]

[1] https://twitter.com/timnitGebru/status/1334364735446331392

Re:Tensions in Google's ethical AI group increase as it send... by cbozeman on Thursday December 17, 2020 @08:22PM (#25462701)
She said, or Google said?

An any rate, this seems to me to be an excellent case study in ultimatums. Namely, don't give one to someone more powerful than you.

Re:Tensions in Google's ethical AI group increase as it send... by pseudalopex on Thursday December 17, 2020 @09:02PM (#25462971)
She quoted Megan Kacholia. Jeff Dean didn't dispute that part of her account.

She expected she would have to leave after her ultimatum. She was fired for a different email.

Re:Tensions in Google's ethical AI group increase as it send... by fatbird on Thursday December 17, 2020 @10:41AM (#25456540)
The only evidence of toxicity was an email she sent after being forced to retract a paper that she wouldn't have to retract under proper academic circumstances, based on feedback they weren't even going to provide to her.

That's not toxic, that's anger. One angry incident, justified or not, does not make the case for firing a "toxic" employee.

Re:Tensions in Google's ethical AI group increase as it send... by room500 on Thursday December 17, 2020 @11:14AM (#25456909)
I disagree. There were several incidents where she appears toxic (and we only know about the ones made public).

1. Absolutely refusing to update her paper with feedback from a colleague - the whole purpose of the internal review

2. Demanding that Google reveal who gave her critical feedback - presumably to attack them in some way

3. Sending an e-mail to her superiors/colleagues, making ultimatums and threatening to leave if her demands were not met

4. Sending a message to a group at Google, telling them to abandon any attempts to help Google with diversity initiatives and instead start attacking their co-workers

5. Publicly blaming Google and saying that she was "fired" for an e-mail. She was relying on information assymetry, knowing that Google would be hesitant to respond fully to all allegations

Re:Tensions in Google's ethical AI group increase as it send... by thu2111 on Thursday December 17, 2020 @11:39AM (#25457177)
You forgot publicly calling both of the best known researchers in the AI revolution racist: Yann LeCunn and Jeff Dean (her manager's manager). And suing her own employer for not being feminist enough, or something.
Re:Tensions in Google's ethical AI group increase as it send... by Aunche on Thursday December 17, 2020 @11:07AM (#25456825)
She also doxxed an HRBP despite having no evidence she was involved during Gebru's firing. I do think she comes off as more passionate than "toxic." a lot of otherwise good people say regrettable things. My issue is that activists will take her accusations of racism at face value, but will dismiss anything outright ridiculous as irrelevant. You can't have it both ways.
Re:Tensions in Google's ethical AI group increase as it send... by xenihn on Thursday December 17, 2020 @10:49AM (#25456607)
>The only evidence of toxicity was an email she sent after being forced to retract a paper that she wouldn't have to retract under proper academic circumstances, based on feedback they weren't even going to provide to her.

What about the paper trail she left on Twitter?

Re:Tensions in Google's ethical AI group increase as it send... by fatbird on Thursday December 17, 2020 @10:53AM (#25456655)
That happened after she was fired. You can't cite that behaviour as a reason for firing her. Violates causality.
Re:Tensions in Google's ethical AI group increase as it send... by dekhn on Thursday December 17, 2020 @11:27AM (#25457038)
I went back and looked at Timnit's twitter history. She has a history of calling out her bosses and saying outrageous things, from well before this incident. People have linked, for example, a tweet where she called out Jeff Dean based on things he said in an internal meeting, and he had to do a bunch of apologizing and backtracking. I can't see how an employee can remain viable after doing that.
Re:Tensions in Google's ethical AI group increase as it send... by xenihn on Thursday December 17, 2020 @10:56AM (#25456687)
Her spat with the Facebook guy was before that.
Re:Tensions in Google's ethical AI group increase as it send... by fatbird on Thursday December 17, 2020 @11:07AM (#25456823)
That was a public argument on her core area of research. Google literally hired her to do that work. Being professionally assertive isn't toxic.
Re:Tensions in Google's ethical AI group increase as it send... by thu2111 on Thursday December 17, 2020 @11:43AM (#25457227)
"I’m sick of this framing. Tired of it. Many people have tried to explain, many scholars. Listen to us. You can’t just reduce harms caused by ML to dataset bias"

That's not being professionally assertive.