News for hackers. Stuff that matters.
Re:Problems in Gemini's Approach to Diversity by ForHackernews on Saturday February 24, 2024 @12:46PM (#39493486)
Is it 'racism' when facial recognition algorithms perform more poorly on dark skin?

It seems like a technical glitch to me. Similarly here, they want the models to represent ethnically diverse individuals, but the model doesn't understand historical context well. It's a technical shortcoming.

Re:Problems in Gemini's Approach to Diversity by anonporridge on Saturday February 24, 2024 @12:49PM (#39493515)
> Is it 'racism' when facial recognition algorithms perform more poorly on dark skin?

No, because that occurred due to an oversight of not including a representative set of training data. At worst it's implicit racism due to oversight and ignorance.

What Google seemed to do here was more explicit racism, by setting configuration in their system that directly and intentionally discriminates based on race. It's fundamentally worse.

Re:Problems in Gemini's Approach to Diversity by ForHackernews on Saturday February 24, 2024 @12:54PM (#39493560)
They both seem like goofs to me. I don't see much qualitative distinction. In both cases, engineers have produced racially dubious results by getting sloppy or lazy with their AI models. Personally, I wouldn't call that "racism" but I see how one could make that argument.
Re:Problems in Gemini's Approach to Diversity by baobabKoodaa on Saturday February 24, 2024 @01:16PM (#39493771)
If you read the OP you will find a link to Google statement where Google officially admits they did this intentionally. They tried to shoot an arrow, and they "missed the mark", oops. They're not sorry for shooting the arrow, they are sorry for missing the mark.

Nobody who worked on facial recognition that failed to recognize black people, nobody in that team was intentionally trying to fail on black people. They didn't try to shoot an arrow, although they accidentally shot one in their own leg.

See how these things are different?

Re:Problems in Gemini's Approach to Diversity by anonporridge on Saturday February 24, 2024 @12:57PM (#39493603)
Is it not obvious that the distinction is intent to discriminate based on race?

Google, in a self imposed noble desire to rectify poor representation of training data, intentionally injected race discrimination in their system. This intent is what makes it fundamentally worse than unintentionally having non diverse training data.

Re:Problems in Gemini's Approach to Diversity by adamsb6 on Saturday February 24, 2024 @01:01PM (#39493646)
They created a mirror. They didn’t like that the mirror showed reality, so they made it into a one way race-changing funhouse mirror.
Re:Problems in Gemini's Approach to Diversity by choeger on Saturday February 24, 2024 @12:52PM (#39493545)
It could be a consequence of racism. Racism lead to white people dominating the United States, which lead to images of white people dominating the internet, which lead to images of white people dominating the training data for facial recognition algorithms.

But it could also just reflect the composition of the population of the countries that dominate the internet.

Re:Problems in Gemini's Approach to Diversity by spidersenses on Saturday February 24, 2024 @01:47PM (#39494070)
If you've been watching movies, TV, played AAA games or saw ads in the last 10 years you would have noticed that intentional blackwashing has been happening for a while.

This hasn't anything to do with unfortunate "training data" for a contemporary AI model.

It's particular egregious in advertisement where even in a country like mine (Germany) where there's less than 1% of the population who are black or African, ads will display 90% black models, white women paired exclusively with black men in unnecessary erotic context, or white women holding mixed-race babies. White men will only appear in negative context like awareness campaigns for testicular cancer or domestic violence. I think at this point it's safe to say that there is a brainwashing agenda at play. So, cui bono?

Re:Problems in Gemini's Approach to Diversity by polotics on Saturday February 24, 2024 @02:25PM (#39494409)
You're looking at adverts trying to get an edge of memorability by triggering cognitive dissonance the way they know will on the German general population...
Re:Problems in Gemini's Approach to Diversity by spidersenses on Saturday February 24, 2024 @03:07PM (#39494734)
That would be a very positive interpretation of the intention behind the strategy. Who would really buy a product where the manufacturer tries to provoke them?

For a historical example have a look at Gillette's failed marketing campaign from a few years ago:

https://time.com/5503156/gillette-razors-toxic-masculinity/

Re:Problems in Gemini's Approach to Diversity by tptacek on Saturday February 24, 2024 @06:00PM (#39495929)
I guess it depends on how much they're paying the mixed-race babies.
Re:Problems in Gemini's Approach to Diversity by lolinder on Saturday February 24, 2024 @01:01PM (#39493650)
Neither case is a purely technical shortcoming—in both the case of facial recognition algorithms performing poorly on dark skin and the case of Gemini refusing to produce images of white people, the technology works that way because of the priorities of the people developing the software, and we can derive the developers' priorities from the software's limitations.

A piece of facial recognition software that doesn't do well with dark skin shows that the team that built it either didn't think to test it on dark skin or didn't feel it was important to get dark skin working before release.

An image generation model that both doesn't produce images of white people spontaneously and will actively refuse to do so when asked shows that the team that built it either failed to ever ask it to produce images of white people or believed that it was a good thing for their model to refuse to produce such images.

In neither case is the problem purely technical.

Re:Problems in Gemini's Approach to Diversity by xepriot on Saturday February 24, 2024 @12:51PM (#39493540)
No, when unintentioned outcomes occur in the world, this is not racism. The sun is not racist for burning white skin more severely than dark skin, and when AI are trained on disproportionately white data, their outputs are not racism.

When racist employees of Google intentionally racially cleanse their products, this is racism.

Let me know what is confusing about the concepts of agency and intention., and I will try to clarify

Re:Problems in Gemini's Approach to Diversity by consumer451 on Saturday February 24, 2024 @12:57PM (#39493594)
You appear to only comment here on HN when race comes up.

So, are the Caucasian people who were involved in any of these miss-optimizations, aka mistakes, racist against themselves? Are they traitors?

Re:Problems in Gemini's Approach to Diversity by throwawa14223 on Saturday February 24, 2024 @02:32PM (#39494460)
At the least they are oikophobes.
Re:Problems in Gemini's Approach to Diversity by ForHackernews on Saturday February 24, 2024 @12:56PM (#39493589)
"I want a model that recognizes faces, but I didn't train it on enough black faces" => not-racism, according to you.

"I want a model that produces racially diverse images of people, but I didn't test it in racially homogenous historical contexts" => yes-racism, according to you.

Re:Problems in Gemini's Approach to Diversity by baobabKoodaa on Saturday February 24, 2024 @01:19PM (#39493801)
> "I want a model that produces racially diverse images of people, but I didn't test it in racially homogenous historical contexts"

You are again misrepresenting the OP. If you go actually read the OP you will find it very clearly describes Google's initial steps towards fixing the problem, which was: double down on race-swapping in historical contexts. The OP very clearly (and correctly) argues that this is not the action of a person who goes "oops forgot to test in this context" but is rather the action of a person who very intentionally wanted the image generator to behave this way in this context.

Re:Problems in Gemini's Approach to Diversity by xepriot on Saturday February 24, 2024 @01:10PM (#39493722)
Did the developers intend their product to manipulate race in its outputs or not? It's a simpler question than these contorted reformulations you present.

But probably not simple enough to pierce ideological bias. I'll ask instead: you really believe that it wasn't tested in historical and other contexts where white people were erased?

Re:Problems in Gemini's Approach to Diversity by ForHackernews on Saturday February 24, 2024 @01:16PM (#39493774)
> I'll ask instead: you really believe that it wasn't tested in historical and other contexts where white people were erased?

Occam's Razor: Of course it wasn't or they wouldn't have released such a ridiculous embarrassing product! C'mon, I think you're the one wearing blinders here.

Re:Problems in Gemini's Approach to Diversity by xepriot on Saturday February 24, 2024 @01:27PM (#39493881)
We'll see what comes out later, but I give it 90:10 odds that this behavior was seen in testing and accepted by developers/DEI commissars - the failure was in not forseeing the reaction of the non-DEI-extremist public.

Of a piece with 'Google more or less explicitly said I won't be promoted because I'm White' stories.

Re:Problems in Gemini's Approach to Diversity by baobabKoodaa on Saturday February 24, 2024 @01:20PM (#39493811)
> Of course it wasn't or they wouldn't have released such a ridiculous embarrassing product!

Then please do explain why their first reaction was to double down on "diversity" in historical contexts, before eventually retreating?

Re:Problems in Gemini's Approach to Diversity by ForHackernews on Saturday February 24, 2024 @01:27PM (#39493879)
Because adding the word "diverse" to the text of to their output is a lot easier than retraining their model? They're always going to try for the easy fix first.

Have you never tried tweaking the error text first before giving up and redesigning your form that's confusing users?

Re:Problems in Gemini's Approach to Diversity by baobabKoodaa on Saturday February 24, 2024 @01:39PM (#39493976)
Hmmh. Fair enough. I didn't think about it from the perspective of "error text", but now that I think in that mental model, I think you're right here.
Re:Problems in Gemini's Approach to Diversity by archsurface on Saturday February 24, 2024 @12:54PM (#39493559)
No, this is not limited to gemini.