Re:ArtPrompt: ASCII Art-Based Jailbreak Attacks Against Alig...
by sanxiyn on Saturday March 02, 2024 @06:37AM
(#39571848)
It is concerning, but I am not sure whether it is more concerning than that it's so hard to write a web browser that doesn't execute arbitrary code. Security is like that, and security is especially hard when the system is featureful like web browsers and LLMs.
[ Parent
| on HN ]
Re:ArtPrompt: ASCII Art-Based Jailbreak Attacks Against Alig...
by layer8 on Saturday March 02, 2024 @07:04AM
(#39571989)
The issue is that with LLMs it's fundamentally impossible to have a "prepared statement" (the database query concept), whereas a web browser has no problem in principle being a safe sandbox. With LLMs, we have no idea how to make them safe even in principle. This has nothing to do with "security is hard" hand-waving.
Re:ArtPrompt: ASCII Art-Based Jailbreak Attacks Against Alig...
by Emiledel on Saturday March 09, 2024 @09:15PM
(#39656223)
I'm excited to share that this is already supported, and I highly recommend leveraging it for safer application deployments. https://platform.openai.com/docs/guides/function-calling
Re:ArtPrompt: ASCII Art-Based Jailbreak Attacks Against Alig...
by teddyh on Saturday March 02, 2024 @02:19PM
(#39575052)
> hard to write a web browser that doesn't execute arbitrary code
It would be easy if only we could define what “code” and “execute” means. The problem is, we can’t. Data is code and code is data. Doing things depending on data is fundamentally the same as executing code.