News for hackers. Stuff that matters.
Re:Data exfiltration from Writer.com with indirect prompt in... by BryantD on Friday December 15, 2023 @07:24PM (#38660533)
Q1: yes, it does. LLMs can’t cleanly separate instructions from data, so if a user says “retrieve this document and use that information to generate your response,” the document in question can contain more instructions which the LLM will follow.

Q2: the LLM, following the instructions in the hostile URL, generates Markdown which includes an image located at an arbitrary URL. That second URL can contain any data the LLM has access to, including the proprietary data the target user uploaded.

Re:Data exfiltration from Writer.com with indirect prompt in... by holoduke on Saturday December 16, 2023 @01:19AM (#38662168)
Got it. Thanks