News for hackers. Stuff that matters.
Re:DALL·E now available in beta by Jerrrry on Wednesday July 20, 2022 @01:29PM (#32169223)
It's not a "problem," it's an unwanted shard of reality piercing through an ideological guise.
Re:DALL·E now available in beta by gnulinux on Wednesday July 20, 2022 @01:44PM (#32169483)
How's it NOT a problem? If I'm trying to produce "stock people images", and if it only gives me white men, it's clearly broken because when I ask for "people" I'm actually asking for "people". I'm having difficulty understanding how it can be considered to be working as intended, when it literally doesn't. Clearly, the software has substantial bias that gets in way of it accomplishing its task.

If I want to produce "animal images" but it only produces images of black cats, do you think there is any question whether it's a problem or not?

Re:DALL·E now available in beta by Jerrrry on Wednesday July 20, 2022 @02:04PM (#32169781)
That is clearly overfitting due to unrepresentative training data.

The "issue" is a different one: that training data - IE, reality, has _unwanted_ biases in it, because reality is biased.

Producing images of men when prompting for "trash collecting workers" should not be much of a surprise: 99% of garbage collection/refuse is handled by men. I doubt most will consider this a "problem," because of one's own bias, nobody cares about women being represented for a "shitty" job.

But ask for picture of CEOs, and then act surprised when most images are of white men? Only outrage, when proportionally, CEO's are, on average, white men.

The "problem" arises when we use these tools to make decisions and further affect society - it has the obvious issue of further entrenching stereotypical associations.

This is not that. Asking DALLE for a bunch of football players, would expectedly produce a huddled group of black men. No issue, because the NFL are disproportionately black men. No outrage, either.

Asking DALLE for a group of criminals, likewise, produces a group of black men. Outage! Except statistically, this is not a surprise, as a disproportionate amount of criminals are black men.

The "problem" is with reality being used as training data. The "problem" is with our reality, not the tooling.

Except in the cases where these toolings are being used to affect society - the obvious example being insurance ML algorithms. et al - we should strive to fix the issues present in reality, not hide them with handicapped training data, and malformed inputs.

Re:DALL·E now available in beta by less_less on Wednesday July 20, 2022 @02:33PM (#32170205)
> This is not that. Asking DALLE for a bunch of football players, would expectedly produce a huddled group of black men. No issue, because the NFL are disproportionately black men. No outrage, either.

This is not great. Only about 57% of NFL players are black, and the percentage is more like 47% among college players. It would be better to at least reflect the diversity of the field, even if you don't think it should be widened in the name of dispelling stereotypes.

> Asking DALLE for a group of criminals, likewise, produces a group of black men. Outage! Except statistically, this is not a surprise, as a disproportionate amount of criminals are black men.

Only about 1/3 of US prisoners are black. (Not quite the same as "criminals" but of course we don't always know who is committing crimes, only who is charged or convicted.) That's disproportionate to their population, but it's not even close to a majority. If DALLE were to exclusively or primarily return images of black men for "criminals", then it would be reinforcing a harmful stereotype that does not reflect reality.

Re:DALL·E now available in beta by cmeacham98 on Wednesday July 20, 2022 @07:47PM (#32173966)
> Asking DALLE for a group of criminals, likewise, produces a group of black men. Outage! Except statistically, this is not a surprise, as a disproportionate amount of criminals are black men.

"criminals" producing most black people actually would be a perfect example of bias in DALL-E that is arguably racism.

Black people commit a diproportionate amoumt of crime (for a variety of socioeconomic reasons I won't get into here), but even so white people make up a majority of criminals (because white people are the largest ethnic group by far).

Thus, a random group of criminals, if representive of reality, should be majority white.

Re:DALL·E now available in beta by TomWhitwell on Wednesday July 20, 2022 @02:19PM (#32169994)
In the UK… “The Environmental Services Association, the trade body, said that only 14 per cent of the country's 91,300 waste sector workers were female.” So 2x dall-e searches should produce 1.2 women.
Re:DALL·E now available in beta by CuriousSkeptic on Wednesday July 20, 2022 @02:16PM (#32169943)
> Asking DALLE for a bunch of football players, would expectedly produce a huddled group of black men

I think, for about 95% of the world football is synonymous with soccer. Its kind of interesting that you take this particular example to represent what reality looks like statistically

Re:DALL·E now available in beta by ceeplusplus on Wednesday July 20, 2022 @02:36PM (#32170260)
Black people comprise 12.4% of the US population, yet they are represented at substantially above that in "OpenAI"'s "bias removal" process. Clearly it has, as you put it, substantial bias that gets in the way of accomplishing its task.
Re:DALL·E now available in beta by mysterydip on Wednesday July 20, 2022 @02:01PM (#32169745)
That's what Jerrrry is saying. Framing the reality of diversity in the world as a "problem" is wrong.
Re:DALL·E now available in beta by ketzo on Wednesday July 20, 2022 @01:41PM (#32169442)
serious question: in what way is that not a “problem?”
Re:DALL·E now available in beta by TheFreim on Wednesday July 20, 2022 @02:03PM (#32169763)
It's not a problem in a few ways, let me know what you think (feel free to ask for clarification).

1. The training data would've been the best way to get organic results, the input is where it'd be necessary to have representative samples of populations.

2. If the reason the model needs to be manipulated to include more "diversity" is that there wasn't enough "diversity" in the training set then its likely the results will be lower quality

3. People should be free to manipulate the results how they wish, a base model without arbitrary manipulations of "diversity" would be the best starting point to allow users to get the appropriate results

4. A "diverse" group of people depends on a variety of different circumstances, if their method of increasing it is as naive as some of the are claiming this could result in absurdities when generating historical images or images relating to specific locations/cultures where things will be LESS representative

Re:DALL·E now available in beta by bobcostas55 on Wednesday July 20, 2022 @01:47PM (#32169541)
Well, it's a problem for the ideology.
Re:DALL·E now available in beta by stuckinhell on Wednesday July 20, 2022 @01:46PM (#32169518)
Everything is an ideological war zone now. That's the world we live in now.
Re:DALL·E now available in beta by Fnoord on Wednesday July 20, 2022 @02:10PM (#32169864)
Perhaps its a problem you don't care about?