Re:Prompt injection explained, with video, slides, and a tra...
by simonw on Saturday May 13, 2023 @10:56PM
(#35934939)
Yeah, the confusion between jailbreaking and prompt injection is definitely a big problem.
People who are frustrated at the safety measure that jailbreaking aims to defeat often assume prompt injection is equally "harmless" - they fail to understands that the consequences can be a lot more severe to anyone who is trying to build their own software on top of LLMs.
People who are frustrated at the safety measure that jailbreaking aims to defeat often assume prompt injection is equally "harmless" - they fail to understands that the consequences can be a lot more severe to anyone who is trying to build their own software on top of LLMs.