News for hackers. Stuff that matters.
Re:GitLost: We Tricked GitHub's AI Agent into Leaking Privat... by sscaryterry on Wednesday July 08, 2026 @06:08AM (#48829989)
This. It’s unsolvable by design.
Re:GitLost: We Tricked GitHub's AI Agent into Leaking Privat... by chrisandchris on Wednesday July 08, 2026 @06:13AM (#48830021)
Partially, you could still deploy the AI in an isolated envirnoment. If there's nothing to access, there's no prompt injection.

But who will have thought about something not being a SaaS but rather on-premises...

Re:GitLost: We Tricked GitHub's AI Agent into Leaking Privat... by SkiFire13 on Wednesday July 08, 2026 @07:07AM (#48830395)
If you feed data to a LLM then there will always be a prompt injection. What you described is limiting the damage that the prompt injection can do, but also its usefulness.
Re:GitLost: We Tricked GitHub's AI Agent into Leaking Privat... by arein3 on Wednesday July 08, 2026 @08:08AM (#48830865)
Why is it limiting the usefulness?

You have a set of apis that user can access to do something, the llm uses those same apis. How is that limiting usefulness? By not invoking apis user is not allowed to?

Re:GitLost: We Tricked GitHub's AI Agent into Leaking Privat... by FromTheFirstIn on Wednesday July 08, 2026 @08:28AM (#48831073)
The only way to mitigate the damage an LLM can do because of prompt injection is to limit what that LLM can do in the first place. That’s what they mean by limiting its usefulness. If an LLM has access to an api and I want it to abuse that API in some way, I can attack its prompt and eventually get it to use the api the way I want
Re:GitLost: We Tricked GitHub's AI Agent into Leaking Privat... by arein3 on Wednesday July 08, 2026 @12:58PM (#48834354)
All apis have to authorize and authenticate if they do sensitive stuff. Otherwise youre asking for it.
Re:GitLost: We Tricked GitHub's AI Agent into Leaking Privat... by NateEag on Wednesday July 08, 2026 @04:25PM (#48836998)
Yes, but whatever the LLM has authenticated access to, an attacker can convince it to mess with on their behalf.
Re:GitLost: We Tricked GitHub's AI Agent into Leaking Privat... by lelanthran on Wednesday July 08, 2026 @06:34AM (#48830186)
> Partially, you could still deploy the AI in an isolated envirnoment. If there's nothing to access, there's no prompt injection.

If there's nothing to access, there's only limited value in using an LLM in the first place.

If your LLM is prevented from accessing anything other than the prompt, the only use is interactive use by the user; no automatic work done on any workflow items.

Re:GitLost: We Tricked GitHub's AI Agent into Leaking Privat... by siws on Wednesday July 08, 2026 @11:11AM (#48833007)
Honest question: couldn't this be solved by setting the authorization level of the agent the same as the user that prompted the question?

In this post's example, the agent would be limited by the author's scope inside the organization and, therefore, be incapable of exposing any unwanted file.

Re:GitLost: We Tricked GitHub's AI Agent into Leaking Privat... by lelanthran on Wednesday July 08, 2026 @11:57AM (#48833612)
> Honest question: couldn't this be solved by setting the authorization level of the agent the same as the user that prompted the question?

No.

> In this post's example, the agent would be limited by the author's scope inside the organization and, therefore, be incapable of exposing any unwanted file.

That still allows prompt injection to exfiltrate the authors files. That's the whole exploit - files that the author has, that he doesn't want exfiltrated.

Re:GitLost: We Tricked GitHub's AI Agent into Leaking Privat... by codethief on Wednesday July 08, 2026 @07:06PM (#48838564)
As the sibling already said, this doesn't work/help in most cases. See https://simonwillison.net/2025/Jun/16/the-lethal-trifecta/ for a different explanation of the issue.