News for hackers. Stuff that matters.

Ask HN: How do you defend support AI agents from voice prompt injection?

We are securing a customer support agent that does the following: - retrieve data around company services from a RAG - is connected to a few tools to escalate to humans and write support tickets - has voice (11labs)

we did complete assessment for normal prompt injection with our tools

but is there any solution for voice attacks?

( 2 comments | 2 points | on HN )
Re:Ask HN: How do you defend support AI agents from voice pr... by mtmail on Thursday June 19, 2025 @06:44AM (#44317327)
Wait, I thought you built such a tool. 4 weeks ago you submitted "We've built an open-source tool to stress test AI agents by simulating prompt injection attacks" https://news.ycombinator.com/item?id=44060292
Re:Ask HN: How do you defend support AI agents from voice pr... by theHolyTrynity on Thursday June 19, 2025 @07:01AM (#44317426)
yes indeed, but it is not enough and was looking to find more stuff to try specifically for voice