News for hackers. Stuff that matters.
Re:Salesforce study finds LLM agents flunk CRM and confident... by burningChrome on Monday June 16, 2025 @12:40PM (#44291144)
It sure sounds like it in the article:

A team led by Kung-Hsiang Huang, a Salesforce AI researcher, showed that using a new benchmark relying on synthetic data, LLM agents achieve around a 58 percent success rate on tasks that can be completed in a single step without needing follow-up actions or more information.

and

The Salesforce AI Research team argued that existing benchmarks failed to rigorously measure the capabilities or limitations of AI agents, and largely ignored an assessment of their ability to recognize sensitive information and adhere to appropriate data handling protocols.

There are no comments on this comment yet.