News for hackers. Stuff that matters.

A comment on AI-powered Bing Chat spills its secrets via prompt injection attack. Parent comment

Re:AI-powered Bing Chat spills its secrets via prompt inject... by nradov on Tuesday February 14, 2023 @12:37PM (#34792895)
That's not the correct way to do security vulnerability analysis. If an API call can cause a disaster then fix the API. Whether the API consumer is an AI or some other type of system is irrelevant.
[ Parent | on HN ]
Re:AI-powered Bing Chat spills its secrets via prompt inject... by Tv9m on Sunday February 26, 2023 @02:12PM (#34948386)
> If an API call can cause a disaster then fix the API

By "API" I'm not referring just to publicly facing REST endpoints. I mean things like shell access for system maintenance, that normally only human professionals like you would be given. In the future it's not clear that humans will be able to dominate that role forever.

Hopefully the issues will be recognized while LLM-based agents are still only serving as retrieval systems.

[ Parent | on HN ]