News for hackers. Stuff that matters.
Re:Multi-modal prompt injection image attacks against GPT-4V by PeterisP on Saturday October 14, 2023 @04:26PM (#37883965)
Despite paying it a lot of lip service, in practice companies demonstrate that they don't really care about security that much, so I don't think that resistance to prompt injection is the main blocker for any products right now; if some product was very useful but had issues with prompt injection, then people would complain a lot about it while still using it and paying for it; and security (much less the even more niche requirement of provable security) would only be a differentiator among multiple competitors providing a comparable product, not a barrier for selling the product in the first place.
Re:Multi-modal prompt injection image attacks against GPT-4V by simonw on Saturday October 14, 2023 @04:59PM (#37884227)
I think prompt injection is the main reason there's been buzz about the idea of autonomous agents and digital personal assistants for months but no one has released a convincing product yet.

Here's an example of an agents company that pivoted partly because they couldn't figure out how to secure them: https://twitter.com/zachtratar/status/1694024240880861571