Agents have already broken out of what were supposed to be sandboxes in the networks of the companies that are supposed to understand what they do. Do you really think banks would be any better?
Supposed to understand, yes. I think a highschool class could do better.
It's not that I think OpenAI and Anthropic know what they're doing - although I can see why my slightly flippant comment might make you think that - but that I just don't trust anyone with these agents, especially when the whole point of using them would be to do that with such critical data.
People really want to run agents on their data.
Re sandboxing: I dont know Goldman's particulars, but most enterprises lock down all sandboxing tech on workstations. So I assume this is actually harder than it seems. So people just run it directly on the machine.
The article is referring to the dilemma of the trifecta twice.
That's exactly the gap I've been working on https://github.com/mickael-kerjean/fdrive you mount your existing data, apply control / permission and can monitor everything the agents are doing with your data
Can the agent read the internet for context? What if the fetch reveals a secret?
I responded by saying they were looking for someone else, and got a response to the effect of “oops that was Copilot, sorry to bother you”
Read into this what you will.
No, I think the risks they are talking about would include things like financial risk due to bad trades based on misinformation from buggy code that the authors don’t understand. This sort of policy pivot happens after an Incident that had a Financially Material Impact.
They also cited productivity concerns, which is also something I’ve observed: some people waste a lot of their time and other’s time do to using these tools to do work they do not understand.