> Ethics in AI should not be so convoluted as to require a separate profession; ethics should be distributed across an organization, flowing through and between individuals so that conversations of design naturally arrive at ethical questions. More crucially, everyone should have the tools to speak up and suggest improvements, so that no one person or set of people hold the keys to building ethical technology.
The same can be true of ethics.
I disagree that professional ethicists aren't needed in an organisation like Google though. Just as security should be lived and breathed by every developer, you still need some experts to consult when things get gnarly, light the way when you need many years of study to understand the concepts, and spot things that laypeople would miss.
The large language models Timnit was studying are a great example of this; people like her were (and are) needed to help the engineers understand the breadth and scope of the issues. Everyone in the org having their hearts in the right place doesn't replace expertise.
Instead, the quote suggests that the separation is unnecessary, and that elevating some people to specifically look at ethics is bad since it's everyone's job
It's good to be critical of your own products to make them better. But you have to actually be willing to do that for it all to work.
It’s a complete disaster to hire people who see their job description as shitting on the company publicly, with no constructive proposals for improvement.
That's what Google was afraid of: the alternative is to decide that the cost of the model isn't worth the effort (externalities < benefit) and to abandon it. Which might be the correct decision, but one that loses Google a lot of potential money.
Really the claim is toxic academia style knife fighting for tenure at best.
"You use too much electricity" is tantamount to "tech is a flawed business model". Arguably solvable with increased green energy sources but that's more a job for society in general than just tech companies.
Moore's law isn't the only way to gain efficiency, and even if the available compute goes up, doesn't mean the total power usage will go down
There are other examples against the meme of AI using "a lot of electricity", for example a recent paper from Google where they show that a learned computational fluid dynamics technique uses only 2% the energy of standard techniques.
BTW, I ran a large scale computing platform at Google for several years. It made absolutely enormous, stunningly huge amounts of CPU available to scientists and we used it to make several important breakthroughs. However, after a few years, I finally was shown what the power cost implications were, and I shut down the project because the costs were not justified by the scientific benefits. Compared to what I was doing, ML is relatively skimpy on CPU.
I believe we reported that Exacycle provided 700K high speed Xeon cores for over a year, and the actual number is far higher (I can't share it because you'd be able to make a reasonable estimate on how many computers Google has).
You gotta pay if you wanna play. Humans are the result of a much longer and more expensive evolutionary process. It's only normal to have to pay a little to do the same for AI.
Either you accept that, or you don't.
"Ethics researches" that can't publish public criticism , with minimal oversight restricted to preventing IP leaks, are a pointless exercise in fake responsibility posturing.
I.e. “Google knew that X would result in Y and they still released X; they should pay for the damages of Y.”
The PR side of ethics research barely matters in comparison.
My first thought was ExxonMobil when I read this comment.
> In July 1977, a senior scientist of Exxon James Black reported to the company's executives that there was a general scientific agreement at that time that the burning of fossil fuels was the most likely manner in which mankind was influencing global climate change.
> According to the Union of Concerned Scientists, "The funding of academic research activity has provided the corporation legitimacy, while it actively funds ideological and advocacy organizations to conduct a disinformation campaign."
Nothing has happened to Exxon Mobile. None of the executives are in prison as far as I know. You'd think the company would be bankrupt by now...
https://en.wikipedia.org/wiki/ExxonMobil_climate_change_cont...
I interpret your point to be that publicly investigating the harm of future products---by the only people who can do so---is a bad idea. What is the alternative? Regulation? (Gasp!)
Perhaps we should start the disinformation campaigns before the products are developed. "If you are arrested on AI-provided evidence, you are guilty. Period."
https://en.wikipedia.org/wiki/Motor_vehicle_fatality_rate_in...
The regulation of automotive safety in the 60's/70's had a huge impact.
> It makes no sense for them to hire their critics and then think they can stay independent. You are basically paying people to shit on your own products. Makes no sense.
Shit on your own products?
So if I'm a good engineer and fix mistakes, I'm "shitting on my company's product?"
There's this belief in this post that un-examined AI is some shiny golden award, and ethics researchers are tarnishing it. It's the other way around.
Well, it depends on your breadth of understanding of the issue. If you have a limited scope, it doesn't seem like a big problem. And it also assumes that we all agree on certain basic human rights. If we don't then yes, it is a matter of perspective.
Read "Weapons of Math Destruction". It discusses how existing algorithms discriminate in the following case-studies:
- courtroom sentencing (and recidivism prediction)
- mortgage and loan rate determination
- educator performance
- job applications that use 3rd party screening tools
The book looks at specific examples of where these black-box algorithms are deployed that have ruined people's lives with no accountability. The ethics concerns that are being raised were needed a decade ago, or more, but it is only getting worse with the ad-hoc deployment of this un-baked technology to almost every industry.
I have to stress again that these black-box algorithms are ALREADY IN USE and cannot be subpoenaed by courts because it is considered intellectual property.
So yes, it is urgent to crack open this technology because it is all too easily being sold without any investigation, accountability, or thought to the consequences. "Move fast and break things" doesn't work if it ruins peoples lives by landing them in jail, or pushing them into poverty.
The book demonstrates this is not a what-if strawman, but reality.
Just as easy as putting the baby back in. It would be more constructive to work on ways to detect and reduce harm.
To follow your analogy, it is more like, "wear a damn condom and take a sex-ed class before having an unwanted baby."
The graph shows that vehicle safety improved steadily throughout the entire 20th century, without any sharp discontinuities. The key line is deaths per billion VMT. That is the figure which is invariant to how much driving people do, and which thus accurately measures how safe driving as an activity is. You appear to be looking at "deaths per million people" but that figure is confounded by big changes driven by the economy, which is why the 1970s energy crisis is highlighted on the graph. All you're seeing there is economic change, not change driven by regulation.
If regulation would have actually made a difference then it'd show up in the red line, but it doesn't. Conclusion: the regulation is useless. Private companies were doing fine at improving safety and always have been. And as regulations have costs, that in turn suggests they should be scrapped (zero impact + non-zero costs = repeal).
They aren't really researching ethics. This is what i think is going on there. recycling an old comment.
{ AI Ethical research can never be an accurate representation of the majority of humanity - or even the majority of its users! If it can it is not sustainable for any long period of time.
What about far more stable principles, such as murder and racism, you ask?
They are prone to being overplayed or downplayed, are state executions murder, or justice? What if the victim/ hangman happens to be black? Why should it matter? Just ignore some issues? That's misleading by omission.
It would be better to just admit "yes, we at Giant Tech know our ethics are bs, but we had to put something down or our machines won't work. Maybe we are not ready for advanced ai. Maybe there's a limit on what programmers can do. Yea. We know. turns out computers DO have limits. We'll have to find other ways to make money."
"But why should we say that!" cry all the executives when this speech is proposed to them.
"because it's true, and if we don't act now the company is screwed. And our clients will also get screwed" is the answer of the timid executive who first suggested this.
"how will the truth help us?" respond all the execs in unison.
"if we can keep up the lie for long enough, we shall all long be millionaires and retired before it implodes! We shall long be out of danger! who cares if some people lose money?"
"Yes, but don't you feel bad for all the shareholders? And how can we possibly fool people for decades to come that our ai isn't bs?" Responds the poor executive weakly.
"By creating a fake team and telling everyone they are ethics researchers" they say. "Really they are just pawns to help us earn more money. Fish get eaten by bigger fish you know?"
"can you just help me change a few lines on my press statement?" Asks the first executive.}
For some reason however, Google and their employees kinda fail to understand this basic tenement of work culture. They're not a scrappy 10 people startup anymore which can be both a workplace and a political party fully agreeing on political issues.
Don't get my hopes up.
what are you left with? misinformation is far more prolific than truth. it needs to be held in check, somehow. ignoring it will make it waorse
I imagine that the conversation beneath that umbrella will be flattened in a day.
Excuse me, but the definition of racism in the west is anything but stable. The definition has changed dramatically in the last decade, and it could change again.
In reality, if you want them to fulfill their true role, they are preventing you from producing wrong products (which should be good for the Company).
But Google understood that as you say (which is not what I think but this is beside the point), and that was their mistake.
It’s been a disaster for Google to have that happen in public.
Importantly, Google offers great work conditions, access to their intellectual property and different evaluation criteria. Many prefer that and other benefits over the stresses of a proper academic career.
It's a very, very tricky thing to do to hire your own public critics, that has to be done very carefully and with a lot of parameters.
They hired them to control them. And it's a diversion to keep people thinking about the wrong things.
There is no reason for Google to pay researchers and to not have some ownership over the process or outcome in some manner, in fact, it's unreasonable to contemplate otherwise.
Google was exceedingly gracious by sponsoring the work and having it make public in the first place.
The demands made of the researchers in question were quite minor, and completely appropriate, and frankly immaterial to the thrust of concerns anyhow.
To boot, accusations of 'racism' are vicious and repulsive.
If researchers want to be completely independent in the terms they might expect in academia - that's entirely understandable - perfectly fine - but they'll have to find jobs elsewhere.
Google has a Search Engine and bunch of other products, and to suggest that their major investment in research should entitle them to some kind of fair parameterize of the process is very reasonable.
To remedy the situation, and an obvious failure on Google's part, they should spend some time thinking about where that line is drawn, and what kind of expectations should be in place. In retrospect, it seems like a management failure for there to have been any misunderstanding on that front. But the point is -> there is a line. Researchers that don't want to with those parameters can make the choice not to. That's why we have both private and publicly funded research.
This case was really just mismanagement by Google. They could have just as well taken those researchers seriously, allow them to investigate whether there is systemic discrimination and then try to correct it, as was the whole point of hiring them in the first place. AI ethics researchers all over the world are publishing articles about the dangers of serious discrimination by large language models. Not addressing this and firing researchers who were working on it on their behalf is not going to help Google in the long run at all.
Google didn't allow the team to make revisions. They stated the paper couldn't be published, period. The difference here is very clearly the management, not the researchers.
If the paper was good it could go through the process and be ready for the next conference. Nobody is seriously suggesting that those words were axed forever.
> The paper was submitted late.
This is not true. The paper was submitted for internal review with about the median amount of notice. The normal internal review process was and is usually very quick, it is not normally a weeks-long back and forth. Importantly, the paper actually passed the normal review process before being submitted to the conference.
> there was a special go/no-go review
It's unclear to what extent the special review was a go/no-go review. It may have been. The review however was not due to the paper being submitted late. As far as I know the special review was actually only done retroactively, after the paper had been submitted externally and approved by the normal internal process.
> If the paper was good it could go through the process and be ready for the next conference.
Even after submission for conference review, there was ample time for back and forth and review internally. Timnit asked if there was feedback she could incorporate into the paper, as even after the paper was submitted to the conference, they could revise it. Google's response was initially to not provide any specific feedback, and then to say that the feedback could not be addressed, the paper could only be unsubmitted.
> Nobody is seriously suggesting that those words were axed forever.
Actually yes, that appears to be precisely what happened.
This is true. There was a requested amount of time and it was not met. To show discrimination you'd also have to show median quality and median editing work required. This paper had a lot of flaws that would be hard to correct without writing it again.
> Importantly, the paper actually passed the normal review process before being submitted to the conference.
But not the corporate review where the people paying the money decided if they thought it was good to attach their name to.
> It's unclear to what extent the special review was a go/no-go review.
Not at all. There was a strong 'No Go' message given. That's how you know.
> The review however was not due to the paper being submitted late.
The "don't bother fixing stuff, we're just kiboshing it" part was.
> after the paper had been submitted externally and approved by the normal internal process.
The normal internal process is about writing quality and fact-checking. The corporate review is entirely separate and always last in the process in order to see the latest version.
> Even after submission for conference review, there was ample time for back and forth and review internally.
No, not for the level of rework they thought it should receive. If it had passed then sure. The reason to meet the deadline is to handle the situation where it doesn't pass on the first go.
> Timnit asked if there was feedback she could incorporate into the paper
And her bosses decided that the paper wasn't worth the last-minute work. I imagine they felt she submitted it late to game the system.
> Google's response was initially to not provide any specific feedback, and then to say that the feedback could not be addressed, the paper could only be unsubmitted
Right, because it wasn't feedback to her. That ship had sailed. It was confidential feedback to her boss about their belief in the quality of the work. To share that feedback would put innocent employees in a Damore position, attacked for feedback they'd been asked to write. Given how she attacked her boss by name it's reasonable to think she'd have included the coworkers, where they'd be pounced on by an angry twitter mob.
> Actually yes, that appears to be precisely what happened.
No. The preprint was released. Google just said "not in our name". And now that she resigned she has the freedom.
Self regulation is preferable (to a private company) to industry-wide regulation, which in turn is preferable to government regulation.
If you want to avoid government oversight, either have internal oversight with the appearance of independence. Alternatively, have an "independent" overseeing body for your industry (whose behavior you may still indirectly control via nominations, seats on boards, funding, etc). Having an actual independent body providing oversight, appointed and controlled by an arm of government body is the worst outcome, yet it is inevitable when lapses arise, and voters demand "something be done" and you failed to provide a veneer of oversight, like Google is doing here.
Ahh, rent-seeking at it's finest. Do we really want to use the tax payer's money to fund this type of behaviors[0]?
[0] https://syncedreview.com/2020/06/30/yann-lecun-quits-twitter...
Except he never said that. He pointed out one algorithm was lazily trained on a non-representative dataset and that it was, therefore, producing biased results.
If you're going to submit your work to an external, independent review board, it's even more important that you have internal people working to address related concerns.
This is a heavy question - it's problematically like elevating an individuals personal moral position, with all their little trivial baggage to something more than it is.
The challenge with these roles is very real: self awareness, objectivity, and processes for arriving at that are probably key. I suggest it would require a lot of engagement, feedback, possibly legal knowledge, reference etc..
AI credibility aside, the individuals chosen by Google previously were not remotely up for the job on a professional level, this was apparent from their public posture and even writing skills, and that's not slander, it's hard job.
As the OP indicates, some degree of objectivity as well, which may be difficult from within the company.
Finally, I would say it's entirely doubtful if AI requires it's own special branch of ethics. Everything Google does touches on ethical issues, and 'plain old search' much more so than perhaps anything else - certainly more than any of their core AI. It's a business and technology issue, not an AI issue. It just may require some insight from those familiar with the company.
All of that said, Google may lose the 'PR cover' of having a woman or PoC in the driver's seat.
What’s their top priority?
Optics? Or better AI? People doing research are not automatically critics, but it is their literal job in this area to ask the hard, hard questions, this is not Harry and Megan go Oprah, this is technology with far-reaching consequences.
This whole drama has nothing to do with neither AI nor ethics.
I mean, the only way to fix bad stuff is to find it?
VW faked their emissions - EPA uncovered it. Google is harming people with bad AI models - Google is uncovering it?
This works if the company is actually interested in finding the mistakes (i.e. MS finding security bugs in Windows), but not if the findings threaten your business.
MS has an interest in fixing security bugs, because it makes their product better.
No big corp has an interest in fixing their ethics, it's usually bad for their profit margins.
These independent researchers should be employed by i.e. a university and funded by government funds, maybe even additionally with an AI regulation fee (i.e. like car makers have to pay to certify their cars).
It makes no sense for them to hire their critics and then think they can stay independent. You are basically paying people to shit on your own products. Makes no sense.