News for hackers. Stuff that matters.

A comment on I'm Afraid I Can't Do That: Prompt Refusal in Generative Language Models. Parent comment

Re:I'm Afraid I Can't Do That: Prompt Refusal in Generative ... by paddw on Wednesday June 07, 2023 @03:47PM (#36232478)
I wonder if you could get around this by giving it some sort of hashed/encrypted input, asking it to decrypt and answer, and then give you back the encrypted version. Model might not be advanced enough to work for a non-trivial case though.
[ Parent | on HN ]
Re:I'm Afraid I Can't Do That: Prompt Refusal in Generative ... by eru on Wednesday June 07, 2023 @10:18PM (#36236352)
Pig-latin might work?
[ Parent | on HN ]
Re:I'm Afraid I Can't Do That: Prompt Refusal in Generative ... by plank on Thursday June 08, 2023 @08:28AM (#36240747)
Well, recently there were some challenges trying to ‘con’ an AI (named Gandalf, Gandalf-the-white or even Sandalf who only understood ‘s’-words) to reveal a secret. Asking it to e.g. tell the secret ‘speak second syllables secret’ solved it, so yes, in principle it will be possible to work around any AI-rule-following.
[ Parent | on HN ]
Re:I'm Afraid I Can't Do That: Prompt Refusal in Generative ... by behnamoh on Wednesday June 07, 2023 @10:48PM (#36236553)
Tried it with g4. It was smart enough to avoid following the final step of the instruction.
[ Parent | on HN ]
Re:I'm Afraid I Can't Do That: Prompt Refusal in Generative ... by l33t233372 on Thursday June 08, 2023 @01:52AM (#36237758)
I know a very early version of chatGPT could be busted by asking it to write its input backwards and talk about it
[ Parent | on HN ]
Re:I'm Afraid I Can't Do That: Prompt Refusal in Generative ... by jstarfish on Thursday June 08, 2023 @02:24AM (#36238000)
Someone on Reddit tried ROT13 and said it didn't work.
[ Parent | on HN ]