News for hackers. Stuff that matters.

A comment on AI-powered Bing Chat spills its secrets via prompt injection attack. Parent comment

Re:AI-powered Bing Chat spills its secrets via prompt inject... by freeqaz on Monday February 13, 2023 @05:19PM (#34781626)
See my comment below with some more context. People are already starting to chain together and extend Chatbots[0] to perform "side effects" automatically (make a search query, check the weather, query a database, etc).

I agree that prompts aren't really "secret" themselves, but the side effects of a bot could be!

0: https://langchain.readthedocs.io/en/latest/modules/agents/ex...

[ Parent | on HN ]
Re:AI-powered Bing Chat spills its secrets via prompt inject... by VectorLock on Monday February 13, 2023 @06:39PM (#34782636)
For ChatGPT at least the side effects are hallucinations. Typically the chat bot can't actually do these things, but they pretend to. Although I guess if you wanted to hook them up to do things automatically you could. Probably not a great idea given their propensity to get things wrong.
[ Parent | on HN ]