News for hackers. Stuff that matters.
Re:Google to pause Gemini image generation of people after i... by ajross on Thursday February 22, 2024 @09:18AM (#39467384)
> actual systemic racism that pervades throughout modern corporate culture

Ooph. The projection here is just too much. People jumping straight across all the reasonable interpretations straight to the maximal conspiracy theory.

Surely this is just a bug. ML has always had trouble with "racism" accusations, but for years it went in the other direction. Remember all the coverage of "I asked for a picture of a criminal and it would only give me a black man", "I asked it to write a program the guess the race of a poor person and it just returned 'black'", etc... It was everywhere.

So they put in a bunch of upstream prompting to try to get it to be diverse. And clearly they messed it up. But that's not "systemic racism", it's just CYA logic that went astray.

Re:Google to pause Gemini image generation of people after i... by itsoktocry on Thursday February 22, 2024 @09:53AM (#39467949)
>But that's not "systemic racism"

When you filter results to prevent it from showing white males, that is by definition system racism. And that's what's happening.

>Surely this is just a bug

Having you been living under a rock for the last 10 years?

Re:Google to pause Gemini image generation of people after i... by lolinder on Thursday February 22, 2024 @09:57AM (#39468021)
You're suggesting that during all of the testing at Google of this product before release, no one thought to ask it to generate white people to see if it could do so?

And in that case, you want us to believe that that testing protocol isn't a systematic exclusionary behavior?

Re:Google to pause Gemini image generation of people after i... by seanw444 on Thursday February 22, 2024 @09:21AM (#39467440)
I mean, the model would be making wise guesses based on the statistics.
Re:Google to pause Gemini image generation of people after i... by ajross on Thursday February 22, 2024 @09:25AM (#39467508)
Oooph again. Which is the root of the problem. The statement "All American criminals are black" is, OK, maybe true to first order (I don't have stats and I'm not going to look for them).

But, first, on a technical level first order logic like that leads to bad decisions. And second, it's clearly racist. And people don't want their products being racist. That desire is pretty clear, right? It's not "systemic racism" to want that, right?

Re:Google to pause Gemini image generation of people after i... by itsoktocry on Thursday February 22, 2024 @09:56AM (#39467999)
>"All American criminals are black"

I'm not even sure it's worth arguing, but who ever says that? Why go to a strawman?

However, looking at the data, if you see that X race commits crime (or is the victim of crime) at a rate disproportionate to their place in the population, is that racist? Or is it useful to know to work on reducing crime?

Re:Google to pause Gemini image generation of people after i... by ajross on Thursday February 22, 2024 @10:16AM (#39468308)
> I'm not even sure it's worth arguing, but who ever says that? Why go to a strawman?

The grandparent post called a putative ML that guessed that all criminals were black a "wise guess", I think you just missed the context in all the culture war flaming?

Re:Google to pause Gemini image generation of people after i... by seanw444 on Thursday February 22, 2024 @11:31AM (#39469479)
I didn't say "assuming all criminals are black is a wise guess." What I meant to point out was that even if black people constitute even 51% of the prison population, the model would still be making a statistically-sound guess by returning an image of a black person.

Now if you asked for 100 images of criminals, and all of them were black, that would not be statistically-sound anymore.