News for hackers. Stuff that matters.
Re:Is Google’s AI research about to implode? by tinyhouse on Tuesday February 23, 2021 @07:46AM (#26236664)
To be fair, the article is not about the firing. In any case, the two researchers who got fired did more harm to Google than good. Internally no one cares they left. AI etichs is an esoteric academic research field.
Re:Is Google’s AI research about to implode? by bo1024 on Tuesday February 23, 2021 @08:53AM (#26237212)
I'm in the research community and I think you're significantly underetsimating the effect of firing Gebru and Mitchell. Machine learning is the hottest research area in computer science and ethics of ML is possibly its hottest subfield. And people pay attention to employers' actions. I think Microsoft Research is still feeling reputation effects from closing down its Silicon Valley lab 10 years ago with no warning. It sent a message to everyone who worked there that they had no job security, and plenty left for academia. The research community is not going to forget about Google's actions here nor, for the most part, will it view Google very favorably.
Re:Is Google’s AI research about to implode? by tinyhouse on Tuesday February 23, 2021 @09:12AM (#26237414)
I think you're very wrong. Yes, there's hype around ML etichs. Trends in ML come and go. Do you see any VC investing in etichs in ML startups? As I said, it's an esoteric academic field.

How do you even compare between the two? MSR closed an entire lab out of the blue of some great researchers who didn't do anything wrong. Here you have two employees going against their company and shitting on it publicly. The only researchers who will not want to work at Google after this saga are the ones Google better off without.

Re:Is Google’s AI research about to implode? by manux on Tuesday February 23, 2021 @10:18AM (#26238235)
> Do you see any VC investing in etichs in ML startups?

Perhaps you should pay less attention to VCs and more attention to governments and academic institutions, who for example in Canada are investing 10s of millions of dollars into AI ethics/FATE/AI for good research.

Sometimes, the point isn't just to make money, it's to actually improve humanity.

Re:Is Google’s AI research about to implode? by tinyhouse on Tuesday February 23, 2021 @11:03AM (#26238831)
The point is not just making money. The point is solving real world problems. AI ethics focus on esoteric problems that don't solve any real world problems. AI ethics research has very little impact if at all on real issues.
Re:Is Google’s AI research about to implode? by manux on Tuesday February 23, 2021 @11:48AM (#26239483)
> AI ethics focus on esoteric problems that don't solve any real world problems

I'm not sure now what you think AI ethics research is. Do you think systemic discrimination is not a real world problem?

Re:Is Google’s AI research about to implode? by tinyhouse on Tuesday February 23, 2021 @12:11PM (#26239815)
Systemic discrimination is indeed a real world problem. That's exactly the problem. AI ethics doesn't help solving systemic discrimination for the simple reason that AI is not causing systemic discrimination.

AI systems are trained on data. There's an abundance of English data which is why systems are often biased to work better on English. Similarly, an image recognition system might be biased if you don't provide it with data representing all demographics. There's nothing new about this and you don't need AI ethics research to solve these issue.

Focusing on AI ethics thinking it has impact on systemic discrimination, instead of focusing on real issues that cause systemic discrimination, is my main issue with all of this.

Re:Is Google’s AI research about to implode? by manux on Tuesday February 23, 2021 @01:00PM (#26240444)
> you don't need AI ethics research to solve these issue.

what are you talking about? This is exactly the kind of research that's classified as AI ethics. "Solving these issues".

> instead of focusing on real issues that cause systemic discrimination

Identifying which ML models _actually running in production_ cause systemic discrimination (e.g. as you mentioned poor image recognition, bail predictions, etc.) is exactly focusing on real issues that... cause systemic discrimination.

> AI is not causing systemic discrimination

This is simply not true. Bad ML models have an impact on systemic discrimination right now, in that they amplify it.

> instead of focusing on real issues that cause systemic discrimination

It's a fallacy to think we can't do both, there's enough humans. Both making better AI and making better societal systems.

Re:Is Google’s AI research about to implode? by tinyhouse on Tuesday February 23, 2021 @01:16PM (#26240635)
> Identifying which ML models _actually running in production_ cause systemic discrimination (e.g. as you mentioned poor image recognition, bail predictions, etc.) is exactly focusing on real issues that... cause systemic discrimination.

There's nothing systemic about these issues. I already mentioned it's a data problem. Nothing new. It's very easy to build a fair image recognition system by representing all demographics. And even then AI systems will continue to make mistakes. Some AI ethics researchers cherry pick on those mistakes to justify their entire research.

Re:Is Google’s AI research about to implode? by manux on Tuesday February 23, 2021 @01:40PM (#26241017)
> It's very easy to build a fair image recognition system by representing all demographics.

I wish it was easy. Unfortunately, reality is more complicated, as it tends to be [1,2,3,4].

[1] https://arxiv.org/abs/2010.03058

[2] https://arxiv.org/abs/1911.05248

[3] https://arxiv.org/abs/2008.11600

[4] https://arxiv.org/abs/1905.12101

> Some AI ethics researchers cherry pick on those mistakes to justify their entire research.

This is a weird statement. This is like saying police cherry pick on criminals to justify their existence.

Do you not believe in harm reduction? Don't you think some part of AI research should be dedicated to minimizing how many "AI systems will continue to make mistakes"?

Re:Is Google’s AI research about to implode? by tinyhouse on Tuesday February 23, 2021 @03:04PM (#26242171)
Thanks for the references. I will check them out once I get a chance. I do know one of these papers and from my understanding the modeling bias is on underrepresented features or the long tail, which again can be thought as a data problem that can be solved with better data collection.

I do agree that in the real world datasets are often biased because they represent the real world... and there are indeed modeling approaches to address such issues. (e.g., designing a loss function to up/down weight of certain types of examples). There's nothing new about this, it's been known in ML for decades.

Re:Is Google’s AI research about to implode? by marshmallow_12 on Tuesday February 23, 2021 @12:54PM (#26240382)
why on earth should i care any more or less about systemic racism just because some charlie tells me it's unethical? Inventing ethics for machines helps cure exactly nothing. Only that i may be deemed by a machine to be an inferior human and less worthy than a "superior" being. Pushing technology that enforces your ideology is a horrible idea.
Re:Is Google’s AI research about to implode? by manux on Tuesday February 23, 2021 @01:03PM (#26240481)
> Pushing technology that enforces your ideology is a horrible idea.

But that's what we're all doing. By being "against AI ethics", you are effectively pushing technology that enforces _your_ ideology.

Your ideology seems to happen to be different than mine, but you would be naive to think that the status quo is somehow "ideology-free".

Do you still think it's a horrible idea? Try being a bit less deontological and a bit more consequentialist. Doing nothing has consequences too.

Re:Is Google’s AI research about to implode? by marshmallow_12 on Tuesday February 23, 2021 @02:33PM (#26241768)
>Your ideology seems to happen to be different than mine.

if you're saying i'm a racist, i'm not. Is everything that some people say are racist actually racist? No. Is racism a problem? absolutely!

The status quo, however, should be changed by people,not people with machines. Doing nothing, that involves not using obscure algorithms to force people to think a certain way is better, in my opinion. You can't call something ethical just because you think it should be; it must be argued out. Using AI to shut out some more of that argument will only create a universal standard, not necessarily the correct one.

Re:Is Google’s AI research about to implode? by manux on Tuesday February 23, 2021 @02:46PM (#26241941)
> if you're saying i'm a racist

I wasn't, sorry if that's what you interpreted.

> The status quo however should be changed by people,not people with machines

I'm not sure I understand what this means. People/companies own machines (and ML models) and use them. So shouldn't we make sure that the machines' decisions align with what people/companies _want_ them to do? (i.e. that the people's ethics align with the ML model's ethical consequences; I'm 100% sure that people who deploy "racist models" don't do it on purpose or out of malice)

> You can't call something ethical just because you think it should be; it must be argued out

On one hand this sounds like a strawman. No one thinks that something is ethical because someone randomly declared it so.

On the other hand... ethics are a human construct, and will continue to evolve as our culture evolves over decades and centuries. Shouldn't we construct ML models which are flexible in that they can align themselves with the ethics we collectively decide? We don't know how to do that yet!

> Using AI to shut out some more of that argument will only create a universal standard, not necessarily the correct one.

You seem to be under the impression that the fields of AI ethics is dedicated to brainwashing people into some particular unpopular moral philosophy. This is simply untrue. Within the field of AI ethics there is a lot of diversity of thought and disagreement on how human morals should be "encoded" so that AI can "align" with these morals. And I'm using the plural of morals because obviously there will never be a humanity-wide consensus on ethics, and if AI is to be deployed in the world it needs to reflect this diversity.

Here's an example of AI people disagreeing if you don't believe me: https://jacobbuckman.com/2021-02-15-fair-ml-tools-require-pr...

Re:Is Google’s AI research about to implode? by marshmallow_12 on Tuesday February 23, 2021 @03:18PM (#26242353)
Ethics and morals don't exist. Full stop.

Codifying ethics perpetuates falsehood. Every single generation in history believed that the "had it" only to be denigrated as hopelessly misguided by the next generation. We are making the same mistake, only less people are killed right now, so it looks like we are more successful. Remember the Pacifism of the inter-war years? it bred fascism. The pendulum swings.

AI ethics cannot hope to remain in style for long, while they will almost certainly exist for far too long. Accepted standards of 2 years ago, are already out of date.

I'm lost for a solution.

I do think that the less AI is claimed to be ethical, the less it will be trusted, which is the best cure i can think of. Honesty is the basis of the whole of scientific inquiry, and is probably scarcer in google's ethics research department than anywhere else in the building. (programs don't run if the math's wrong, economics as well)

Re:Is Google’s AI research about to implode? by manux on Tuesday February 23, 2021 @04:02PM (#26242852)
No, you're wrong. Ethics and morals do exist. Money exists. Ideas exist in our brain, functionally.

Are all these things _ideas_? Human creations? Sure. The universe is absolutely indifferent to us. But these _ideas_ have real-world impact, and I'm not indifferent to my own suffering.

Societies function at the scale they do right now because there is enough overlap in how I perceive the world and how another random human perceives the world so that even though we don't know each other, we can still cooperate [see e.g. 1 for great discussions on this] e.g. exchange money for goods.

[1] https://www.preposterousuniverse.com/podcast/2021/02/01/132-...

> AI ethics cannot hope to remain in style for long

Again, you seem to be conflating "AI ethics" with a particular ethical stance, let's call it woke humanism, and you seem to think that the people who work on AI ethics work to enforce this belief on others. This is wrong. We're perfectly aware that humans have a variety of ethical preferences, see my previous post. Lots of people who work in "AI ethics" are definitely not woke humanists.

> Accepted standards of 2 years ago, are already out of date.

I'm not sure what you're trying to say here. Um, sure we keep finding better algorithms... no one ever, ever, ever, has claimed that their paper is the ultimate algorithm and no no one will find better. But 2 years ago, killing a random person in the street was wrong. It's still wrong today, it was wrong 2000 years ago, and it's going to stay this way for the foreseeable future.

> I'm lost for a solution

The research field of AI ethics exists because we don't know what the solution is!!! Come join us if you're so concerned.

> Honesty is the basis of the whole of scientific inquiry

If you value honesty, then you should value research that tries to make ML models "honest", by revealing how they make the predictions they do and where that fails. I don't understand your antagonism towards ML FATE (fairness accountability transparency and ethics) research

Re:Is Google’s AI research about to implode? by marshmallow_12 on Tuesday February 23, 2021 @05:27PM (#26243801)
my points still stand. History has shown us that defining ethics and writing them down merely spreads falsehood. I don't think we are actually better off morally now then 50 years ago. In some areas yes, in others we have regressed. (look at addiction rates now) Now to categorically state that ai ethics is as diverse as "traditional" ethics can't be true by definition. (mine, if you ask)

As for killing random people on the street never being socially acceptable... ...Just look at europe 80 years ago.

AI Ethical research can never be an accurate representation of the majority of humanity - or even the majority of its users! If it can it is not sustainable for any long period of time.

What about far more stable principles, such as murder and racism, you ask?

They are prone to being overplayed or downplayed, are state executions murder, or justice? What if the victim/ hangman happens to be black? Why should it matter? Just ignore some issues? That's misleading by omission.

It would be better to just admit "yes, we at Giant Tech know our ethics are bs, but we had to put something down or our machines won't work. Maybe we are not ready for advanced ai. Maybe there's a limit on what programmers can do. Yea. We know. turns out computers DO have limits. We'll have to find other ways to make money."

"But why should we say that!" cry all the executives when this speech is proposed to them.

"because it's true, and if we don't act now the company is screwed. And our clients will also get screwed" is the answer of the timid executive who first suggested this.

"how will the truth help us?" respond all the execs in unision.

"if we can keep up the lie for long enough, we shall all long be millionaires and retired before it implodes! We shall long be out of danger! who cares if some people lose money?"

"Yes, but don't you feel bad for all the shareholders? And how can we possibly fool people for decades to come that our ai isn't bs?" Responds the poor executive weakly.

"By creating a fake team and telling everyone they are ethics researchers" they say. "Really they are just pawns to help us earn more money. Fish get eaten by bigger fish you know?"

"can you just help me change a few lines on my press statement?" Asks the first executive.

Re:Is Google’s AI research about to implode? by manux on Tuesday February 23, 2021 @08:29PM (#26245504)
I think you're missing the point I'm trying to make, which is that developing "fair" algorithms, is not about developing algs that are e.g. pro-white-black equality, it is about developing algs that have option of equality built-in. It is then up to the user of the algorithm (you, Google, whoever), to "input" what or who should be equal.

It just so happens that currently the "input" is racial and gender equality. That's a societal choice, and one that is likely to change if e.g. racial equality is achieved and some new inequality arises. Maybe eye-color-based discrimination, who knows.

More generally than "equality", AI Ethics research gives us tools to analyze current methods and see where they fail to meet our ethical standards.

> History has shown us that defining ethics and writing them down merely spreads falsehood

Humans have been trying to improve their own condition for as long as there have been humans. Collectively defining acceptable behaviors is a never-ending task. Does that mean we should not undertake it? Absolutely not!

Writing down ethics isn't about spreading falsehoods, it's about cooperation. Cooperation involves compromise:

> AI Ethical research can never be an accurate representation of the majority of humanity - or even the majority of its users! If it can it is not sustainable for any long period of time.

Laws can never be an accurate representation of the majority of humanity - or even the majority of its users! If it can it is not sustainable for any long period of time.

Culture can never be an accurate representation of the majority of humanity - or even the majority of its users! If it can it is not sustainable for any long period of time.

Morals can never be an accurate representation of the majority of humanity - or even the majority of its users! If it can it is not sustainable for any long period of time.

Do you see the pattern? Things change, that's normal. We still have laws, and culture and morals, but we adapt them to our needs. Are you suggesting we should simply reject anything that changes? You won't be left with much.

I'm still very much interested in improving my own condition. That includes pushing people to behave in ways which I think would do that. People have different interests and their condition is often at odds with other people's condition. This is the foundational difficulty of living in a society of more than 1 individual. Yet we 8 billion humans still manage to be fairly successful at it. I wonder why?

Cultures and morals change. Does that make the morals of the past falsehoods? Of course not. They're just different perspectives on the human condition, probably best suited to the material conditions of the past.

Calling someone today is often seen as rude when a text would suffice. This is due to our material conditions, the ubiquity of cellphones.

> It would be better to just admit ...

You're suggesting we should admit defeat? Give up and let Google maximize profit? AI is a wonderful tool that could improve the material conditions of most of humanity if used correctly. It could also be devastating. I'd rather it not be devastating, so I'm going to continue supporting people who try to do research into aligning AI with whatever ethics we collectively agree on.

> I don't think we are actually better off morally now then 50 years ago

This is pretty sad.

Don't confuse your own cynicism vis-à-vis big tech with some nihilistic historical inevitability. The global improvement of the material conditions of people in the last 50 years have enabled us to start asking for ourselves what morals we actually want on a global scale, rather than this exercise being left solely to a self-interested elite.

Regardless of how better off morally _you_ think we are or aren't now, the space of collective possibilities is now immensely larger, whether you like it or not. That, is wonderful.

Re:Is Google’s AI research about to implode? by fock on Tuesday February 23, 2021 @12:14PM (#26239853)
So, could you tell me for example, what this relatively often cited paper solves or where it's actually applied to solve a real world problem? https://openreview.net/forum?id=Sy2fzU9gl
Re:Is Google’s AI research about to implode? by tinyhouse on Tuesday February 23, 2021 @12:58PM (#26240431)
I don't know this paper but it doesn't matter. I didn't say only ethics in AI research doesn't solve real world problems. It's a research field mostly for academia not industry IMHO. Obv many ethics researchers would disagree with me on this and that's OK. Partly because they would rather have the option to work at Google with FAANG salary vs a middle tier university in the middle of nowhere.
Re:Is Google’s AI research about to implode? by pyrale on Tuesday February 23, 2021 @10:18AM (#26238237)
You seem to have an already strongly formed opinion on the topic, and it seems it would be very hard for people to have you even acknowledge that they may have valuable diverging views.

Starting from that point, what do you expect from a discussion? What kind of information would lead you to think again about the situation?

Re:Is Google’s AI research about to implode? by tinyhouse on Tuesday February 23, 2021 @11:04AM (#26238864)
I'm happy to change my view if someone shows real world issues AI ethics research is helping in solving.
Re:Is Google’s AI research about to implode? by xiphias2 on Tuesday February 23, 2021 @10:51AM (#26238678)
I'm much more scared about the singularity (AI safety) in the ethics field than models having bias, while the models are improving accuracy over time.

People say that AGI is still far away, but I haven't seen any results of being able to contain the harm AGI can do to us humans.

What these researchers are doing is the easy part of AI ethics.

Re:Is Google’s AI research about to implode? by jack_riminton on Tuesday February 23, 2021 @10:16AM (#26238208)
Why would a VC invest in an ethics startup?

How much money something can make is not a good arbiter of how important it is

e.g. the hippocratic oath

Re:Is Google’s AI research about to implode? by RcouF1uZ4gsC on Tuesday February 23, 2021 @10:32AM (#26238428)
In terms of attracting AI researchers, think of this:

Gebru has very publicly got into fights with Yann LeCunn and now with Jeff Dean. If you are building AI, who would you rather build your team around, Dean/LeCunn or Gebru? If you are an AI researcher, do you want a join a team where one of the team members is in the habit of aggressively accusing other researchers of racism? Would you be worried that your research might fall within their crosshairs for some reason or another? For example, if you are working on natural language research, and your model ends up doing better with Indo-European languages versus those from other families, do you want to be accused of propagating racist power structures on Twitter?

Re:Is Google’s AI research about to implode? by bo1024 on Tuesday February 23, 2021 @06:00PM (#26244178)
I don't think that's the right question. It's just about if Google can attract top researchers (or needs to).
Re:Is Google’s AI research about to implode? by blueblisters on Tuesday February 23, 2021 @10:41AM (#26238534)
> ethics of ML is possibly its hottest subfield.

Is this really true? I don't see ethics in ML papers getting the same attention in major conferences as theoretical or experimental breakthroughs in deep / reinforcement learning.

Don't get me wrong, ethics could be hot outside the ML academia, but I very much doubt it's something majority of grad students in ML are dying to get into.

Re:Is Google’s AI research about to implode? by bo1024 on Tuesday February 23, 2021 @05:54PM (#26244116)
Not sure, depends who you ask. But almost every deep learning and RL innovation opens a can of ethics worms...
Re:Is Google’s AI research about to implode? by lrhegeba on Tuesday February 23, 2021 @10:22AM (#26238279)
i guess you are right that potential employees will consider this behaviour in their calculations. for the most part by adjusting their salary demands with an additional "risk adjustment bonus". as the FAANG can easily swallow that additional cost and are still incredibly attractive i doubt there will be a big effect besides loosing some value-oriented people. i doubt this will make a difference numbers-wise. nonetheless i applaud employees sharing their view of a companies inner workings for us others to have more information to make an informed decision themselves - yeah transparency
Re:Is Google’s AI research about to implode? by fmajid on Tuesday February 23, 2021 @07:55AM (#26236738)
More importantly it has no connection to the bottom line, which is why Google management doesn't seem particularly concerned with disquiet in that research group, as long as it doesn't spread to the rest of the company.
Re:Is Google’s AI research about to implode? by tkgally on Tuesday February 23, 2021 @08:30AM (#26236991)
Google and other companies should regard rigorous research and discussion about AI ethics as long-term protection of their bottom lines. If they start launching products and selling services that are found to unfairly favor or disfavor certain groups of people, they will be vulnerable to lawsuits, government regulation, and damage to their reputations.
Re:Is Google’s AI research about to implode? by SpicyLemonZest on Tuesday February 23, 2021 @10:22AM (#26238291)
One of the core issues in AI ethics, really the core issue currently, is that any product you launch or service you run will be found by some subset of the population to unfairly favor certain groups of people. No amount of research will allow Google to build a model so neutral everyone has to agree with it, because people want different things and have different ideas and assumptions about what's fair. As they found in 2019 with their AI ethics board, even basic ideas like "let's listen to everyone" are subject to this dilemma, because some groups feel that it's unfair to listen to other groups.
Re:Is Google’s AI research about to implode? by azmodeus on Tuesday February 23, 2021 @09:37AM (#26237740)
I think it is important to shift AI ethics to become more of an investment but that requires more tooling to evaluate AI ethics problems and the business risks.
Re:Is Google’s AI research about to implode? by pyrale on Tuesday February 23, 2021 @10:25AM (#26238329)
This may not change end of year results, but this kind of research is what gives Google a credible voice when it comes to shaping public discourse and influencing legislative process, for instance.
Re:Is Google’s AI research about to implode? by tiahura on Tuesday February 23, 2021 @09:52AM (#26237940)
AI etichs is an esoteric academic research field.

I would argue it’s a Public Relations field.

Re:Is Google’s AI research about to implode? by marshmallow_12 on Tuesday February 23, 2021 @10:34AM (#26238457)
i agree. Ethics means nothing. It's just an emotional security blanket. They are no more qualified than a 5 year old to invent ethical standards.
Re:Is Google’s AI research about to implode? by Tenoke on Tuesday February 23, 2021 @08:27AM (#26236963)
>AI etichs is an esoteric academic research field.

I don't agree in general but I do think these two researchers, and this whole saga have just hurt the AI ethics field.

Re:Is Google’s AI research about to implode? by DavidSumpter on Tuesday February 23, 2021 @10:54AM (#26238708)
But when you write something like this, do you also understand that their actual research is widely considered to be of a high quality and very important? So if you agree that ethics is important, would you leave them off a top 10 list (and who would you put on)?
Re:Is Google’s AI research about to implode? by djmips on Tuesday February 23, 2021 @09:00AM (#26237278)
I speculate this article is because of the firing.