News for hackers. Stuff that matters.
Re:Salesforce study finds LLM agents flunk CRM and confident... by jzelinskie on Monday June 16, 2025 @12:40PM (#44291140)
I recommend folks check out the linked paper -- it's discussing more than just confidentiality tests as a benchmark for being ready for B2B AI usage.

But when it comes to confidentiality, having fine-grained authorization securing your RAG layer is the only valid solution that I've seen in used in industry. Injecting data into the context window and relying on prompting will never be secure.

Re:Salesforce study finds LLM agents flunk CRM and confident... by sausagefeet on Monday June 16, 2025 @02:09PM (#44291912)
Is that sufficient? I'm not very adept at modern AI but it feels to me like the only reliable solution is to not have the data in the model at all. Is that what you're saying accomplishes?
Re:Salesforce study finds LLM agents flunk CRM and confident... by rafaelmn on Monday June 16, 2025 @03:31PM (#44292672)
Yes. It's basically treat the model as another frontend approach - that way the model has the same scopes as any frontend app would.
Re:Salesforce study finds LLM agents flunk CRM and confident... by spwa4 on Tuesday June 17, 2025 @06:53PM (#44304884)
Why wouldn't the human mind have the same problem? Hell, it's ironic because one thing ML is pretty damn good at is to get humans to violate their prompting, and, frankly, basic rational thought:

https://www.ic3.gov/PSA/2024/PSA241203

Or, more concretely:

https://edition.cnn.com/2024/02/04/asia/deepfake-cfo-scam-ho...