Re:Prompt injection explained, with video, slides, and a tra...
by simonw on Saturday May 13, 2023 @11:05PM
(#35934980)
If you're completely confident that there's no way an attacker might get their text into your user's LLM session then yeah, you have nothing to worry about.
Potential vectors to consider:
- Your app lets users run it against text from other sources - fetched web pages, incoming messages - server logs - which an attacker might be able to influence
- Your users can copy and paste text into your app - and an attacker might be able to trick them into eg copying in a dozen paragraphs of text without first reading it to check for weird hidden prompt instructions
Potential vectors to consider:
- Your app lets users run it against text from other sources - fetched web pages, incoming messages - server logs - which an attacker might be able to influence
- Your users can copy and paste text into your app - and an attacker might be able to trick them into eg copying in a dozen paragraphs of text without first reading it to check for weird hidden prompt instructions