News for hackers. Stuff that matters.
Re:Gemma: New Open Models by epistasis on Wednesday February 21, 2024 @02:22PM (#39458262)
Is it intentional? You think they intentionally made it not understand skin tone distribution by country? I would believe it if there was proof, but with all the other things it gets wrong it's weird to jump to that conclusion.

There's way too much politics in these things. I'm tired of people pushing on the politics rather than pushing for better tech.

Re:Gemma: New Open Models by Workaccount2 on Wednesday February 21, 2024 @02:39PM (#39458461)
>I'm tired of people pushing on the politics rather than pushing for better tech.

I'm surprised you're not attacking google over this then...

Re:Gemma: New Open Models by robswc on Wednesday February 21, 2024 @02:46PM (#39458555)
I mean, I asked it for a samurai from a specific Japanese time period and it gave me a picture of a "non-binary indigenous American woman" (its words, not mine) so I think there is something intentional going on.
Re:Gemma: New Open Models by trackflak on Wednesday February 21, 2024 @03:23PM (#39458996)
Ah, I remember when such things were mere jokes. If AI 'trained' this way ever has a serious real world application, I don't think there will be much laughing.
Re:Gemma: New Open Models by kweingar on Wednesday February 21, 2024 @07:49PM (#39461695)
I would be very surprised if it said "nonbinary indigenous American woman" considering that nonbinary and woman are different categories
Re:Gemma: New Open Models by robswc on Wednesday February 21, 2024 @09:38PM (#39462496)
You're right, my mind inserted "woman" to go with the picture:

https://gemini.google.com/share/ba324bd98d9b

At least it would never make such a heinous mistake like that :)

Re:Gemma: New Open Models by bakugo on Wednesday February 21, 2024 @02:33PM (#39458384)
> Is it intentional? You think they intentionally made it not understand skin tone distribution by country? I would believe it if there was proof, but with all the other things it gets wrong it's weird to jump to that conclusion.

Yes, it's absolutely intentional. Leaked system prompts from other AIs such as DALL-E show that they are being explicitly prompted to inject racial "diversity" into their outputs even in contexts where it makes no sense, and there's no reason to assume the same isn't being done here, since the result seems way worse than anything I've seen from DALL-E and others.

Re:Gemma: New Open Models by xsdu on Thursday February 22, 2024 @07:55AM (#39466383)
I thought the same, until I saw the Gemini engineer on Twitter. The mystery ends there, it's definitely intentional.