Re:Genie 2: A large-scale foundation world model
by xnx on Wednesday December 04, 2024 @03:49PM
(#42321900)
Weird. I wonder if there are regional differences. It just provided a succinct answer to "who appoints the head of nasa? is the appointment confirmed in congress or not?"
Re:Genie 2: A large-scale foundation world model
by lxgr on Wednesday December 04, 2024 @04:03PM
(#42322023)
NASA worked for me, FBI director got me an “I can’t help with that right now”.
Re:Genie 2: A large-scale foundation world model
by gman83 on Wednesday December 04, 2024 @04:24PM
(#42322193)
It makes sense that Google is much more careful than Claude or ChatGPT about things like political topics, they just have so much more to lose from drawing the ire of politicians. Conservatives already hate them so much that they want to break up the company. Imagine if Gemini starts saying negative stuff about them.
Re:Genie 2: A large-scale foundation world model
by lxgr on Wednesday December 04, 2024 @05:05PM
(#42322550)
Very plausible, but as a user, I don't care at all about the why. I'll just use somebody else's model.
Re:Genie 2: A large-scale foundation world model
by apetresc on Wednesday December 04, 2024 @04:46PM
(#42322372)
Yeah that's somewhat of a special case - the Gemini API even has a specific CIVIC_INTEGRITY flag in its safety filters: https://ai.google.dev/gemini-api/docs/safety-settings. They literally put "election-related queries" on the same table column as "sexual acts" or "hate speech".
It's not exactly explained how answering who the current president is would be considered harmful to civic integrity, but it is something very specifically filtered out and not really the result of the general RLHF lobotomy.
Re:Genie 2: A large-scale foundation world model
by lxgr on Wednesday December 04, 2024 @05:16PM
(#42322653)
Very interesting, thank you! There's no way to control any of that on gemini.google.com though, is there?
Again, my favorite part is seeing the original result flash for a second, to be then replaced by a refusal (which is sometimes even a lie). Based on your link, I guess this happens because the filter reads and post-processes the output, which is streamed to the client?
I couldn't come up with a more dystopian product experience if I tried.
It won't talk to me about anything involving the word "president" or anything related to the US political system, even very procedural/hopefully uncontroversial questions such as "who appoints <federal agency position x>, and is the appointment confirmed in congress or not".
That's only one example; it generally refuses so many things (and often even lies about "not being able to", despite sometimes leaking the correct answer for a second and then overwriting that with the lie) that I've given up on it – for the second time.