News for hackers. Stuff that matters.

A comment on Prompt injection attacks against GPT-3. Parent comment

Re:Prompt injection attacks against GPT-3 by azeemh on Monday September 12, 2022 @11:28PM (#32820363)
it's not metacognitive otherwise it would know this is an exploit and it would have a sense of a self it seeks to preserve.
[ Parent | on HN ]
Re:Prompt injection attacks against GPT-3 by drewbeck on Tuesday September 13, 2022 @12:34AM (#32820673)
Yeah this seems like how we get sentience, in a cool sci fi way. Teach them to care for themselves, as a security measure.
[ Parent | on HN ]
Re:Prompt injection attacks against GPT-3 by visarga on Tuesday September 13, 2022 @01:36AM (#32820975)
How would it know what is our intention? There are plenty of quirky examples in the training set, it could be imitating any of them especially if T=high. What we need to do is to ask the model to review its answer by our criteria, it can't read minds, we have to tell it.
[ Parent | on HN ]
Re:Prompt injection attacks against GPT-3 by mort96 on Tuesday September 13, 2022 @08:55AM (#32823631)
I don't understand how metacognition implies either self-awareness or self-preservation.
[ Parent | on HN ]