Re:Bing ChatGPT Image Jailbreak
by MacsHeadroom on Sunday October 01, 2023 @11:53PM
(#37733788)
I guarantee I can convince someone to run my SQL command for me despite such safeguards. Humans are notoriously easy to jailbreak.
I'm sure you can. That's social engineering, not SQL injection.
I don't think it's easy (or even possible) to build a completely secure system.
But... for most security vulnerabilities (such as SQL injection) there are known, reliable mitigations.
That's not the case for prompt injection, which is why we need to treat it differently from other classes of vulnerability.
(I'll need a solid chunk of consulting cash for the time it takes to conduct that audit, of course!)