Genie 2: A large-scale foundation world model

Re:Genie 2: A large-scale foundation world model by apetresc on Wednesday December 04, 2024 @04:46PM (#42322372)

Yeah that's somewhat of a special case - the Gemini API even has a specific CIVIC_INTEGRITY flag in its safety filters: https://ai.google.dev/gemini-api/docs/safety-settings. They literally put "election-related queries" on the same table column as "sexual acts" or "hate speech".

It's not exactly explained how answering who the current president is would be considered harmful to civic integrity, but it is something very specifically filtered out and not really the result of the general RLHF lobotomy.

[ Parent | on HN ]

Re:Genie 2: A large-scale foundation world model by lxgr on Wednesday December 04, 2024 @05:16PM (#42322653)

Very interesting, thank you! There's no way to control any of that on gemini.google.com though, is there?

Again, my favorite part is seeing the original result flash for a second, to be then replaced by a refusal (which is sometimes even a lie). Based on your link, I guess this happens because the filter reads and post-processes the output, which is streamed to the client?

I couldn't come up with a more dystopian product experience if I tried.

[ Parent | on HN ]