News for hackers. Stuff that matters.

A comment on Microsoft's Pivotal AI Product Is Running into Big Problems. Parent comment

Re:Microsoft's Pivotal AI Product Is Running into Big Problems by xmcqdpt2 on Thursday February 05, 2026 @07:45AM (#46899047)
I tried copilot agent once, and it just claimed that it accessed a website that should have been blocked by corporate firewalls and uploaded a bunch of proprietary data. Lots of very specific information about how it clicked on specific buttons of the website etc.

We raised a high priority ticket with MS and turns out that Copilot Agent lied about the entire thing because the website was blocked. It completely made it up.

The fact that we are supposed to use Copilot Agent for open-ended "research" is mind-boggling.

[ Parent | on HN ]
Re:Microsoft's Pivotal AI Product Is Running into Big Problems by inglor_cz on Thursday February 05, 2026 @08:14AM (#46899274)
How did it know about the buttons? Or were they so generic that it could hallucinate them as well?

I wonder if the site you mentioned was earlier harvested through some firewall hole during Copilot's training.

[ Parent | on HN ]
Re:Microsoft's Pivotal AI Product Is Running into Big Problems by xmcqdpt2 on Friday February 06, 2026 @07:14AM (#46911887)
It must have either pulled the websites docs or knew about them.
[ Parent | on HN ]
Re:Microsoft's Pivotal AI Product Is Running into Big Problems by p_ing on Thursday February 05, 2026 @08:58AM (#46899695)
Copilot uses the Bing search index to access public content. Your corporate firewall is irrelevant.
[ Parent | on HN ]
Re:Microsoft's Pivotal AI Product Is Running into Big Problems by xmcqdpt2 on Friday February 06, 2026 @07:15AM (#46911895)
Turns out that's not true, at least where I work. IT / Microsoft confirmed that all Copilot traffic goes through our corporate firewall.
[ Parent | on HN ]
Re:Microsoft's Pivotal AI Product Is Running into Big Problems by p_ing on Friday February 06, 2026 @05:27PM (#46919005)
Whomever you spoke to is misinformed.

https://learn.microsoft.com/en-us/copilot/microsoft-365/mana...

[ Parent | on HN ]