When you filter results to prevent it from showing white males, that is by definition system racism. And that's what's happening.
>Surely this is just a bug
Having you been living under a rock for the last 10 years?
And in that case, you want us to believe that that testing protocol isn't a systematic exclusionary behavior?
But, first, on a technical level first order logic like that leads to bad decisions. And second, it's clearly racist. And people don't want their products being racist. That desire is pretty clear, right? It's not "systemic racism" to want that, right?
I'm not even sure it's worth arguing, but who ever says that? Why go to a strawman?
However, looking at the data, if you see that X race commits crime (or is the victim of crime) at a rate disproportionate to their place in the population, is that racist? Or is it useful to know to work on reducing crime?
The grandparent post called a putative ML that guessed that all criminals were black a "wise guess", I think you just missed the context in all the culture war flaming?
Now if you asked for 100 images of criminals, and all of them were black, that would not be statistically-sound anymore.
Ooph. The projection here is just too much. People jumping straight across all the reasonable interpretations straight to the maximal conspiracy theory.
Surely this is just a bug. ML has always had trouble with "racism" accusations, but for years it went in the other direction. Remember all the coverage of "I asked for a picture of a criminal and it would only give me a black man", "I asked it to write a program the guess the race of a poor person and it just returned 'black'", etc... It was everywhere.
So they put in a bunch of upstream prompting to try to get it to be diverse. And clearly they messed it up. But that's not "systemic racism", it's just CYA logic that went astray.