AI-powered Bing Chat spills its secrets via prompt injection attack

Re:AI-powered Bing Chat spills its secrets via prompt inject... by moyix on Monday February 13, 2023 @10:13PM (#34784776)

I don't tend to worry too much about prompt exfiltration, agreed. But people are also hooking up LLMs in ways that allow them to trigger API calls and take other actions, and that can lead to some fun attacks:

https://twitter.com/hwchase17/status/1608467493877579777

And of course there was the fun example of how users were able to get a GPT-powered twitter bot intended to promote remote work to threaten the president:

https://twitter.com/simonw/status/1570568047618031617

[ Parent | on HN ]

Re:AI-powered Bing Chat spills its secrets via prompt inject... by nradov on Tuesday February 14, 2023 @12:26AM (#34785727)

So what. That bot didn't actually threaten the president, at least not in any way that would legally be considered a threat under US federal law.

[ Parent | on HN ]