News for hackers. Stuff that matters.
Re:How We Rooted Copilot by simonw on Saturday July 26, 2025 @12:36PM (#44695309)
OK, I think I understand what this is about: the vulnerability that they reported (and Microsoft fixed) is that there was a trick you could use to run your own code with root privileges inside the container - when the system was designed to have you only execute code as a non-root user.

It turned out not to really matter, because the container itself was still secured - you couldn't make network requests from it and you couldn't break out of it, so really all you could do with root was mess up a container that only you had access to anyway.

Re:How We Rooted Copilot by pamelafox on Saturday July 26, 2025 @01:16PM (#44695582)
I don’t know specifically how this container was implemented, but Microsoft has a standard way to do isolated Python sandboxes: https://learn.microsoft.com/en-us/azure/container-apps/sessi... Hopefully this feature is using that or something similar.
Re:How We Rooted Copilot by ajross on Saturday July 26, 2025 @12:51PM (#44695415)
In the modern world vulnerabilities are stacks. Asserting that "the container itself was still secured" is just a statement that the attackers didn't find anything there. But container breakouts and VM breakouts are known things. All it takes is a few mistakes in configuration or a bug in a virtio driver or whatever. This is a real and notable result.
Re:How We Rooted Copilot by simonw on Saturday July 26, 2025 @12:54PM (#44695442)
If they had found and reported a container breakout I expect they would've got a bug bounty from it!

Are there any known unfixed container breakouts at the moment in the kind of systems Microsoft are likely to be using here?

Re:How We Rooted Copilot by DSMan195276 on Saturday July 26, 2025 @01:20PM (#44695615)
The problem is that you're encouraging people to keep stuff like this to themselves until they can use it to perform an exploit that they'd get paid for, which is the opposite of what Microsoft wants - they'd much rather you report it now so that if an exploit does get found that requires root they would potentially be protected.

The simple question for Microsoft to answer is - does it matter to them if attackers have root access on the container? If the answer is yes then the bug bounty for root access should at least pay something to encourage reporting. If the answer is no then this shouldn't have been marked as a vulnerability because root access is not considered a security issue.

Re:How We Rooted Copilot by tptacek on Saturday July 26, 2025 @03:06PM (#44696274)
Almost certainly yes, since at that point all you're looking for is a Linux kernel LPE.
Re:How We Rooted Copilot by VBprogrammer on Saturday July 26, 2025 @01:19PM (#44695604)
Presumably someone with mal-intent would sit on the root vulnerability waiting for a container breakout bug to come around.
Re:How We Rooted Copilot by thfuran on Saturday July 26, 2025 @01:24PM (#44695642)
But a $5 wrench isn't a critical security vulnerability just because someone somewhere might one day find the right person to apply it to to extract important credentials.
Re:How We Rooted Copilot by VBprogrammer on Saturday July 26, 2025 @01:31PM (#44695677)
A container root exploit isn't a critical security vulnerability either, describing it as moderate seems fair, but it's a reasonable step towards one.
Re:How We Rooted Copilot by worik on Saturday July 26, 2025 @05:50PM (#44697188)
That is exactly what it is.

Propper security I depth means that when trusted actors betray the system, the damage is limited.

Re:How We Rooted Copilot by ajross on Saturday July 26, 2025 @06:06PM (#44697299)
Not really the right metaphor. A $5 wrench isn't a "vulnerability" because it's $5! Tools that are accessible to everyone are part of the threat model, not something you can eliminate or avoid. This trick is novel and new.

Like, consider your personal cult was built around an "unopenable" bolt-tighted box. Then someone invents the wrench in an attempt to open it. That would be a clear "security vulnerability", right?

Re:How We Rooted Copilot by thfuran on Saturday July 26, 2025 @06:51PM (#44697533)
Not a serious one if all the wrench actually gets you is access to the room that contains the box that no known tool can open, which is a closer analogy to what happened.
Re:How We Rooted Copilot by ajross on Saturday July 26, 2025 @07:33PM (#44697752)
Again, though, you're taking "all that gets you" as a prior when (abandoning the metaphor) container and VM escapes are routine vulnerabilities. They just weren't the subject of this particular team who wanted to hack on AI. You don't do security analysis by presuming the absence of vulnerabilities!

Modern security is defense in depth. The AI pre-prompting setup was the first layer, and it was escaped. The UID separation inside the container was another, and it was broken. The container would have been next. And hopefully there are network firewalls and egress rules on top of that, etc... And all of those can and have failed in the past.

Re:How We Rooted Copilot by tptacek on Saturday July 26, 2025 @11:44PM (#44698776)
Sure, I guess, but a lot more is broken than Copilot if you assume arbitrary container escape. (I do!)
Re:How We Rooted Copilot by pbhjpbhj on Saturday July 26, 2025 @08:24PM (#44697960)
And an exploit that breaks out of the sandbox is not really anything if it needs root to work... so if a hacker had those two MS wouldn't care about them selling those bugs because both of them are not serious. See, perfect security and it didn't cost them anything.
Re:How We Rooted Copilot by worik on Saturday July 26, 2025 @05:48PM (#44697170)
> they would've got a bug bounty from it!

Why do you think that, rather than get sued? I am curious

Re:How We Rooted Copilot by simonw on Saturday July 26, 2025 @07:41PM (#44697791)
Microsoft have a bug bounty program which is credible and well run.

Suing people who responsibly disclose security issues to you is a disastrous thing to do. Word spreads instantly and now you won't get any responsibly disclosed bug reports in the future.

Microsoft are way too smart to make that mistake.

Re:How We Rooted Copilot by 0xbadcafebee on Saturday July 26, 2025 @04:33PM (#44696749)
I have to give Microsoft props here. Most companies don't bother to lock things down well enough, but they were thorough.
Re:How We Rooted Copilot by stogot on Saturday July 26, 2025 @06:37PM (#44697453)
I would give the one engineer the credit for doing things better, not Microsoft. Microsoft overall culture of security is terrible. Look at the CISA report.
Re:How We Rooted Copilot by kenjackson on Saturday July 26, 2025 @07:32PM (#44697746)
What CISA report?
Re:How We Rooted Copilot by aspenmayer on Saturday July 26, 2025 @07:54PM (#44697843)
I’m guessing they mean this one:

https://www.cisa.gov/news-events/bulletins/sb25-167

> Microsoft--Microsoft 365 Copilot

> Description Ai command injection in M365 Copilot allows an unauthorized attacker to disclose information over a network.

> Published 2025-06-11

> CVSS Score 9.3

> Source Info CVE-2025-32711

https://www.cve.org/CVERecord?id=CVE-2025-32711

And maybe they are referring to this engineer from the linked advisory notes?

https://msrc.microsoft.com/update-guide/vulnerability/CVE-20...

> Acknowledgements

> Arantes (@es7evam on X) with Microsoft Aim Labs (Part of Aim Security)

Re:How We Rooted Copilot by NemosDemos on Saturday July 26, 2025 @11:26PM (#44698705)
Not OP, but guessing they were referencing this one:

https://www.cisa.gov/resources-tools/resources/CSRB-Review-S...

Re:How We Rooted Copilot by stogot on Sunday July 27, 2025 @08:05AM (#44700724)
Re:How We Rooted Copilot by homarp on Sunday July 27, 2025 @10:55AM (#44701768)
Re:How We Rooted Copilot by bigfatkitten on Saturday July 26, 2025 @08:31PM (#44697993)
Microsoft has islands of security excellence in what these days is a sea of mediocrity.
Re:How We Rooted Copilot by 0xbadcafebee on Saturday July 26, 2025 @09:51PM (#44698275)
Okay, so I give the team that put this together credit. Hopefully the parent company sees based on this that it's worth letting teams invest more in quality and security work, over features.
Re:How We Rooted Copilot by dudeinjapan on Sunday July 27, 2025 @02:07AM (#44699212)
We should give all the credit to the Product Manager because he told the engineers to make it secure.
Re:How We Rooted Copilot by chrz on Sunday July 27, 2025 @04:37AM (#44699811)
Lets send a thank you letter to Bill Gates
Re:How We Rooted Copilot by dudeinjapan on Sunday July 27, 2025 @07:11AM (#44700426)
I presume you mean Bill Gates Sr. because he fathered Bill Gates.
Re:How We Rooted Copilot by bravesoul2 on Sunday July 27, 2025 @04:55AM (#44699885)
I bet the container was in an isolated VM too.
Re:How We Rooted Copilot by j-krieger on Sunday July 27, 2025 @06:20AM (#44700225)
Every infra I ever worked in used this pattern to a degree. Many proxmox vm's in a kubernetes cluster.
Re:How We Rooted Copilot by silverliver on Sunday July 27, 2025 @06:54AM (#44700372)
I've seen people manually create a separate unprivileged user on the host for each VM they run, so for them the pattern becomes:

1. VM running on hypervisor as unprivileged host user

2. Container running in VM as unprivileged vm user

3. Payload running in container as unprivileged container user.

Not sure whether layered isolation is worth the increased attack surface. For normal users (not targets of state actors), it probably is.

Re:How We Rooted Copilot by stevage on Saturday July 26, 2025 @06:53PM (#44697539)
It seems weird to me that copilot sometimes refuses to execute code but sometimes allows it. What exactly are they aiming for?
Re:How We Rooted Copilot by wizzwizz4 on Saturday July 26, 2025 @07:56PM (#44697855)
They're not. It's better to think of Copilot as a collaborative storytelling session with a text autocomplete system, which some other program is rudely hijacking to insert the result of running certain commands.

Sometimes the (completion randomly selected from the outputs of the) predictive text model goes "yes, and". Other times, it goes "no, because". As observed in the article, if it's autocompleting the result of many "yes, and"s, the story is probably going to have another "yes, and" next, but if a story starts off with a certain kind of demand, it's probably going to continue with a refusal.

Re:How We Rooted Copilot by stevage on Saturday July 26, 2025 @09:37PM (#44698217)
funny how it sounds kind of the opposite of how people might work. Get enough 'no's from someone and they might finally cave in. get enough 'yes'es and they might get sick of doing everything you ask.
Re:How We Rooted Copilot by dangero on Sunday July 27, 2025 @01:37AM (#44699133)
Sales people are specifically trained to manipulate people by asking them questions that they will say ‘yes’ to because once people start to say yes, they tend to continue to say it.
Re:How We Rooted Copilot by wizzwizz4 on Sunday July 27, 2025 @04:40AM (#44699823)
Only when certain pressure is applied. If you're paying attention when someone's doing this to you, you can feel (and disregard) the tendency to keep saying "yes".
Re:How We Rooted Copilot by immibis on Sunday July 27, 2025 @09:47AM (#44701289)
It's narrowing down the space of all possible conversations. One with a lot of nos is probably a conversation with someone who says no a lot. An early LLM result was that you got higher-quality translations if you demarcated the answer with "the expert French translator says:" instead of just "French translation:"
Re:How We Rooted Copilot by keisborg on Sunday July 27, 2025 @04:24AM (#44699741)
One step closer to container breakout? Gaining root access give you a bigger attack surface for kernel exploits.