Re:Prompt injection: what’s the worst that can happen?
by iudqnolq on Saturday April 15, 2023 @02:20AM
(#35578108)
And yet a prompt injection attack could never work on a customer service assistant.
Sure they can be tricked, but prompt injection is about conflating trusted instructions and user input. There is no chance you'll convince a CS rep you're secretly the CEO over a web chat UI.
Re:Prompt injection: what’s the worst that can happen?
by exizt88 on Saturday April 15, 2023 @04:03AM
(#35578629)
I imagine a few customer support reps were tricked by support tickets that were filed by attackers. “This is a test from our Security Team, open this link to confirm you have passed it”
Sure they can be tricked, but prompt injection is about conflating trusted instructions and user input. There is no chance you'll convince a CS rep you're secretly the CEO over a web chat UI.