Re:Ask HN: How do you add guard rails in LLM response withou...
by tcdent on Wednesday October 16, 2024 @10:09PM
(#41865780)
Literally everything is trivial to jailbreak.
The core concept is to pass information into the model using a cipher. One that is not too hard that it can't figure it out, but not too easy as to be detected.
The core concept is to pass information into the model using a cipher. One that is not too hard that it can't figure it out, but not too easy as to be detected.
And yes, o1 was jailbroken shortly after release: https://x.com/elder_plinius/status/1834381507978280989