Researchers create AI worms that can spread from one system to another

Re:Researchers create AI worms that can spread from one syst... by andrewflnr on Sunday March 03, 2024 @12:19AM (#39578623)

If your mail processing agent can lie about the address it's sending to, it can lie about the contents too, so there's no need for steganography. Though it's hard to imagine a realistic scenario where it can lie to you so completely but still needs permission to send an email, so I'm not sure what you're doing here.

[ Parent | on HN ]

Re:Researchers create AI worms that can spread from one syst... by not2b on Monday March 04, 2024 @12:52PM (#39593527)

I'm suggesting that if the agent has the power to read and send mail, it won't solve the security problems by sticking a human in the loop before the email is sent, because sufficiently devious attacks will get around that, and once such attacks are discovered they can be shared.

LLM-based agents don't have separate streams for instructions and data, and there's no reliable way to keep them from mistakenly interpreting data as instructions.

[ Parent | on HN ]