News for hackers. Stuff that matters.
Re:‘The Godfather of A.I.’ Leaves Google and Warns of Danger... by cubefox on Tuesday May 02, 2023 @12:24PM (#35790006)
Well, that was probably jailbreaking. That's not really prompt injection, but the problem of letting a model execute some but not all instructions, which could get bamboozled by things like roleplaying. In contrast to jailbreaking, proper prompt injection is Bing having access to websites or emails, which just means the website gets copied into its context window, giving the author of the website potential "root access" to your LLM. I think this is relatively well fixable with quote tokens and RL.

There are no comments on this comment yet.