Re:Delimiters won’t save you from prompt injection
by dontlaugh on Saturday May 13, 2023 @10:50AM
(#35928941)
Exactly, just don’t do in-band signalling.
[ Parent
| on HN ]
Re:Delimiters won’t save you from prompt injection
by taeric on Saturday May 13, 2023 @11:02AM
(#35929048)
I've been surprised that I haven't seen out of band signalling as a major suggestion. There a reason for that?
Re:Delimiters won’t save you from prompt injection
by User23 on Saturday May 13, 2023 @11:37AM
(#35929402)
How exactly do you imagine that working?
Re:Delimiters won’t save you from prompt injection
by taeric on Saturday May 13, 2023 @11:54AM
(#35929578)
Another thread finally made it click for me. I hadn't looked at the mechanics of why the current method is used. Which seems to be that a ton a synthetic training data is added that allows in band instructions.
And this is precisely the catch, as there is no out of band stream to a language model. It is only completing a single channel of text/tokens. So, yeah, I think I get it, now.