News for hackers. Stuff that matters.

A comment on AI-powered Bing Chat spills its secrets via prompt injection attack. Parent comment

Re:AI-powered Bing Chat spills its secrets via prompt inject... by space_fountain on Tuesday February 14, 2023 @03:03AM (#34786719)
Except that would miss that it’s already been helpful to me and many other people and that would trivialize it
[ Parent | on HN ]
Re:AI-powered Bing Chat spills its secrets via prompt inject... by woolion on Tuesday February 14, 2023 @03:19AM (#34786822)
Well, it would be a good analogy to think of it as genius colleague with very strong mental issues. That colleague can answer most of your questions well, but sometimes you get something that is completely insane, even if it makes some sense locally. And you have no idea what will trigger it or when that colleague is going to have his fits.

So sure, it can be helpful, but how do you mitigate the risks?

[ Parent | on HN ]
Re:AI-powered Bing Chat spills its secrets via prompt inject... by thegabriele on Tuesday February 14, 2023 @03:45AM (#34786982)
So it is human after all
[ Parent | on HN ]
Re:AI-powered Bing Chat spills its secrets via prompt inject... by tempodox on Wednesday February 15, 2023 @03:50AM (#34801506)
No, it's software that's being anthropomorphized. That's not the same.
[ Parent | on HN ]