I would expect AI to at least generate answers consistent with reality. If I ask for a historical figure who just happens to be white, AI needs to return a picture of that white person. Any other race is simply wrong. If I ask a question about racial based statistics which have an objective answer, AI needs to return that objective answer.
If we can't even trust AI to give us factual answers to simple objective facts, then there's definitely no reason to trust whatever AI says about complicated, subjective topics.
Existing services hallucinate all the time. They can't even do math reliably, nor can you be reasonably certain it can provide actual citations for any generated facts.
If people are getting upset about the proportion of whatever race in the results of a query, a simple way to fix it is to ask them to specify the number and proportions they want. How could they possibly be offended then? This may lead to some repulsive output, but I don't think there's any point trying to censor people outside of preventing illegal pornography.
But thinking what we want is worth discussing. Maybe they should have some diversity/etnicity dial with the default settings somewhere in the middle between no correction and overcorrection now.
It’s a great question, and one where you won’t find consensus. I believe we should aim to avoid arrogance. Rather than prescribing a world view, prescribe a default and let the users overwrite. Diversity vs. reality should be a setting, in the users’ control.
It seems truth is the only line that isn’t arbitrary.
When you prompt "business man" and it outputs a white man, this is quite probably reflective of representation in reality.
Whether this overrepresentation is even a problem at all is debatable as the idea that every job, role or subgroup of people is perfectly diverse or that this even should be the goal isn't just ridiculous, it's demographically impossible.
If you do have a problem with a specific representation in actual reality, reality itself should change. Which it does, it just takes time.
In the meanwhile, just prompt "black business man" if that's what you were after.
This isn't their only option... they could also just ask for more information.
A good approach here would be ask the user to further clarify what exactly they want before generating a person — "Do you want a random depiction or a specific depiction". A good tool for users is one which helps them be and feel more tactically or predictably in control of it; which means making them aware of its behavioural pitfalls so they can avoid them if they want to.
The thing is, you don't fix this by changing the user prompt. You fix this by "removing" the bias on your dataset!
Removing under quotes because of course you are just changing to another accepted bias.
The problem with “corrections” is that they obscure the truth. If you’re being given information and start forming perceptions that no longer map onto reality you’re actually in a much worse position to change or do anything about reality itself. It’s basically like you’re being lied to and misled. How can you fix the situation if you don’t even have the facts at hand or you’re not being made aware of the facts?
Yet humans are doomed to forget and relive history.
In my opinion, some corrections are worthwhile. In this case they clearly overdone it or it was a broken implementation. For sure there will be always people who are not satisfied. But I also think that the AI services should be more open about exact guidelines they impose, so we can debate those.