Re:ChatGPT agent: bridging research and action
by DanHulton on Thursday July 17, 2025 @04:19PM
(#44597713)
There is almost guaranteed going to be an attack along the lines of prompt-injecting a calendar invite. Those things are millions of lines long already, with tones of auto-generated text that nobody reads. Embed your injection in the middle of boring text describing the meeting prerequisites and it's as good as written in a transparent font. Then enjoy exfiltrating your victim's entire calendar and who knows what else.
[ Parent
| on HN ]
Re:ChatGPT agent: bridging research and action
by WXLCKNO on Thursday July 17, 2025 @05:54PM
(#44598665)
In the system I'm building the main agent doesn't have access to tools and must call scoped down subagents who have one or two tools at most and always in the same category (so no mixed fetch and calendar tools). They must also return structured data to the main agent.
I think that kind of isolation is necessary even though it's a bit more costly. However since the subagents have simple tasks I can use super cheap models.
Re:ChatGPT agent: bridging research and action
by __jonas on Thursday July 17, 2025 @07:56PM
(#44599676)
What isolation is there? If a compromised sub agent returns data that gets inserted into the main agents context (structured or not) then the end result is the same as if the main agent was directly interacting with the compromising resource is it not?
Re:ChatGPT agent: bridging research and action
by itsalotoffun on Friday July 18, 2025 @06:13AM
(#44603024)
Exactly. You can't both give the model access AND enforce security. You CAN convince yourself you've done it though. You see it all the time, including in this thread.