News for hackers. Stuff that matters.
Re:ZombAIs: From Prompt Injection to C2 with Claude Computer... by simonw on Sunday October 27, 2024 @08:34AM (#41962132)
If you ship an API version of a model that is demonstrably resistant to prompt injection today you'll make more than $10m from it.

If you find a solution and publish a paper describing it your lifetime earning potential may go up by that amount too. A lot of very valuable use-cases are blocked on this right now.

Re:ZombAIs: From Prompt Injection to C2 with Claude Computer... by resistattack on Sunday October 27, 2024 @09:53AM (#41962635)
Interesting. Unfortunately (for me at least), I don't have a solution for this problem, but I think such a prize could improve the chances of new breakthroughs in security that allows ai agents use secrets in many tasks. Allocating resources for crucial tasks is an intelligent decision.