News for hackers. Stuff that matters.
Re:Yishan Wong: "Google's Gemini issue is not about woke/DEI" by monsecchris on Friday February 23, 2024 @03:42AM (#39478335)
The woke results were by design. This was not a mistake or unpredictable.
Re:Yishan Wong: "Google's Gemini issue is not about woke/DEI" by 4bpp on Friday February 23, 2024 @04:12AM (#39478532)
Are you contending that the black Wehrmacht soldiers, or black British kings eating watermelon, were anticipated or desired by Google staff?

Even if you model them as the most extreme conceivable woke boogeymen, surely they wouldn't want a scenario where the diversity programming produced a result that they would consider more insulting to minorities than the one that would have been produced without it.

Re:Yishan Wong: "Google's Gemini issue is not about woke/DEI" by weweersdfsd on Friday February 23, 2024 @06:26AM (#39479325)
The Google staff responsible were clearly lacking imagination. I think next time Google should consider hiring a QA team consisting of teenagers from 4chan, I think they would excel at the job of figuring out ways to generate offensive content with the app.

Of course even better would be utilizing more balanced training data, so you don't need silly and badly working prompt engineering to force more diversity.

Re:Yishan Wong: "Google's Gemini issue is not about woke/DEI" by lostmsu on Friday February 23, 2024 @12:31PM (#39483571)
"By design" is not the same as "what we wanted".
Re:Yishan Wong: "Google's Gemini issue is not about woke/DEI" by 4bpp on Friday February 23, 2024 @02:24PM (#39485009)
That's precisely what is typically considered to be the problem of AI alignment.
Re:Yishan Wong: "Google's Gemini issue is not about woke/DEI" by 15457345234 on Friday February 23, 2024 @05:47PM (#39487126)
> want a scenario where the diversity programming produced a result that they would consider more insulting to minorities

They're trolls. They don't care about minorities. They just use diversity to wind people up because then they can press the 'white fragility' button when people complain and segue into another level of trolling. If minorities get offended they'll attack them with 'uncle tom' and 'oreo' type insults.

You are not dealing with people operating in good faith, it's obvious. Expecting their actions to make sense is pointless. They just love drama. Performance artists. Theater kids. Somehow they've got in there and have formed a little nucleus of toxicity which is why the company's headed downhill so fast.

Someone alludes to it here:

https://news.ycombinator.com/item?id=39485537

And I've seen this happen. You hire one, they get some leverage to hire their buddies, before you know it they've set up their own little clown show and nobody wants to go anywhere near them. Then the wrecking starts.