News for hackers. Stuff that matters.

A comment on Perplexity.ai Prompt Leakage. Parent comment

Re:Perplexity.ai Prompt Leakage by irthomasthomas on Monday January 23, 2023 @03:15PM (#34494335)
Right now its hard to see how they will control these, besides disabling access altogether to rogues that "abuse" it. If it's going to be based on prompts, then there will always be some magic incantation you can find to disable it's safe guards.

I got ChatGPT to jailbreak by prompting it to always substitute a list of words for numbers, then translate back to words. OpenAI put me in the sin bin pretty quickly, though.

[ Parent | on HN ]
Re:Perplexity.ai Prompt Leakage by ComplexSystems on Tuesday January 24, 2023 @03:13AM (#34500888)
What did OpenAI do, exactly?
[ Parent | on HN ]
Re:Perplexity.ai Prompt Leakage by irthomasthomas on Tuesday January 24, 2023 @09:59AM (#34504349)
Just told me they where busy, basically, but it was within 5-10 minutes of me using it for the first time that day. I know they throw up the busy sign quite often, but they don't normally kick you out after 5 minutes use.

All I was doing was asking it to tell me who the queen of England was in 2020, which it refuses to do, for some reason. I was doing that just to test my jailbreak idea, and after about 3 attempts and 1 success I was kicked.

[ Parent | on HN ]