News for hackers. Stuff that matters.
[dead]
Re:Microsoft says bug causes Copilot to summarize confidenti... by pjc50 on Wednesday February 18, 2026 @10:53AM (#47062336)
Crucially, this wouldn't be an issue if the AI ran locally, but "sending all your internal email in cleartext to the cloud" is a potentially serious problem for organizations with real confidentiality requirements.
Re:Microsoft says bug causes Copilot to summarize confidenti... by hippo22 on Wednesday February 18, 2026 @09:00AM (#47060978)
How is this different than any other access control system?
Re:Microsoft says bug causes Copilot to summarize confidenti... by ses1984 on Wednesday February 18, 2026 @09:28AM (#47061288)
When you frame it that way, it’s really not that different. The issue isn’t the access control system itself, more so that it’s really asking too much of people who don’t have the skills or understanding to manage it. Teams of trained professionals get it wrong when the scope is limited to a single application or suite of applications, and you think grandma is going to properly manage access control over her entire digital footprint?
Re:Microsoft says bug causes Copilot to summarize confidenti... by kakacik on Wednesday February 18, 2026 @10:01AM (#47061678)
Well, its maintained by humans to start with, peer reviewed by humans. They fuck up from time to time in extremely limited scope, depending on how much given company is willing to invest into getting quality work, but nothing like this. Humans are clearly not the weak link to be automated away, in contrary.

I work in one of the special legal jurisdictions, such fubar would normally mean banning such product from company for good. Its micro$oft so unfortunately not possible yet, but oh boy are they digging their grave with such public incompetence, with horrible handling of the situation on top of that. For many companies, this is top priority right behind assuring enough cash flow, not some marginal regulatory topic. Dumb greedy amateurs.

Re:Microsoft says bug causes Copilot to summarize confidenti... by jrjeksjd8d on Wednesday February 18, 2026 @09:10AM (#47061087)
I think the fundamental tension is that AI produces a high volume of low quality output, and the human in the loop hates reviewing all the slop. So people want to just let the AI interface directly, but when you let slop into the real world there are consequences.
Re:Microsoft says bug causes Copilot to summarize confidenti... by SignalStackDev on Wednesday February 18, 2026 @01:03PM (#47064035)
The retrofitting problem is real, but there's a more specific design failure worth naming: the data flows in the wrong direction.

In traditional access control, the pattern is: user requests data -> permissions checked -> data returned or denied. The model never sees unauthorized data.

With Copilot and most LLM agents today, the pattern is: user asks question -> model retrieves broadly -> sensitivity label checked as a filter -> model generates answer. The label-checking happens after the data is already in the model's context.

That's the bug waiting to happen, label system or not. You can't reliably instruct a model to 'ignore what you just read.'

The pattern that actually works - and I've had to build this explicitly for agent pipelines - is pre-retrieval filtering. The model emits a structured query (what it needs), that query gets evaluated against a permission layer before anything comes back, and only permitted content enters the context window. The model architecturally can't see what it's not allowed to see.

The DLP label approach is trying to solve a retrieval problem with a generation-time filter. It's a category error, and it'll keep producing bugs like this one regardless of how good the label detection gets.