Re:Perplexity.ai Prompt Leakage
by irthomasthomas on Monday January 23, 2023 @03:15PM
(#34494335)
Right now its hard to see how they will control these, besides disabling access altogether to rogues that "abuse" it. If it's going to be based on prompts, then there will always be some magic incantation you can find to disable it's safe guards.
I got ChatGPT to jailbreak by prompting it to always substitute a list of words for numbers, then translate back to words. OpenAI put me in the sin bin pretty quickly, though.
Re:Perplexity.ai Prompt Leakage
by ComplexSystems on Tuesday January 24, 2023 @03:13AM
(#34500888)
What did OpenAI do, exactly?
Re:Perplexity.ai Prompt Leakage
by irthomasthomas on Tuesday January 24, 2023 @09:59AM
(#34504349)
Just told me they where busy, basically, but it was within 5-10 minutes of me using it for the first time that day. I know they throw up the busy sign quite often, but they don't normally kick you out after 5 minutes use.
All I was doing was asking it to tell me who the queen of England was in 2020, which it refuses to do, for some reason. I was doing that just to test my jailbreak idea, and after about 3 attempts and 1 success I was kicked.
Select the "Davinci" model in the Playground. It is the closest to unfiltered, very hard to use, and some people say it is the most creative.
In my experience, I've found it easier to get higher quality answers for specific tasks using text-davinci-003 than with ChatGPT. The ability to adjust temperature, frequence penalty, etc. can be a bit intimidating coming from just talking to ChatGPT but it actually helps a lot to 'steer' it.
Re:Perplexity.ai Prompt Leakage
by Der_Einzige on Monday January 23, 2023 @03:58PM
(#34494953)
I wrote a whole paper and contributed a GitHub repo and HF space about using filters applied to the LLMs vocabulary before decoding to solve a huge problem with hard constrained text generation in LLMs.
https://paperswithcode.com/paper/most-language-models-can-be...
Re:Perplexity.ai Prompt Leakage
by politician on Monday January 23, 2023 @05:07PM
(#34495812)
The Priesthood of Prompt Wizards are the only people allowed to approach the GPT.
I worry that those filter models will eventually end up being censorship* machines.
* yes in the figurative sense of the word, I know the "it's not censorship unless the government does it, otherwise it's just sparkling censor water" argument and it's being pedantic to intentionally miss the point.
Will our future AI mega-sytems be so walled off that very few people will even be allowed to talk to the raw model? I feel this is the wrong path somehow. If I could download GPT-3 (that is if OpenAI released it) and I had hardware to run it, I would be fascinated to talk to the unfiltered agent. I mean there is good reason people are continuing the open community work of Stable Diffusion under the name of Unstable Diffusion