Re:I'm Afraid I Can't Do That: Prompt Refusal in Generative ...
by skissane on Wednesday June 07, 2023 @04:40PM
(#36233222)
> It's not okay to make jokes about people when those jokes are actually harmful.
The problem is, what groups are at risk of harm varies around the world-whereas OpenAI’s idea of “alignment” is based on a one-size-fits-all US-centric understanding of that.
You can say “it is okay to make pointed/stereotypical jokes about Christians but not about Jews or Muslims, because the latter are at risk of being harmed by those jokes but the former are not”-but what happens when the user is from Israel or from Egypt?
The problem is, what groups are at risk of harm varies around the world-whereas OpenAI’s idea of “alignment” is based on a one-size-fits-all US-centric understanding of that.
You can say “it is okay to make pointed/stereotypical jokes about Christians but not about Jews or Muslims, because the latter are at risk of being harmed by those jokes but the former are not”-but what happens when the user is from Israel or from Egypt?