Re:EchoLeak – 0-Click AI Vulnerability Enabling Data Exfiltr...
by whatevertrevor on Thursday June 12, 2025 @05:28PM
(#44263394)
Maybe I don't understand your idea.
I thought it was the LLM deciding what chain of tools to apply for each input. I don't see great accuracy/usefulness for a one time chain of tool generation via LLM that would somehow generalize to multiple inputs without the LLM part of that loop in the future.
Re:EchoLeak – 0-Click AI Vulnerability Enabling Data Exfiltr...
by theHolyTrynity on Thursday June 19, 2025 @05:50AM
(#44317027)
not sure how much we can apply this here, but how about specific LLM judges that look for manipulation of I/O?
Of course, the generated chain being buggy and vulnerable would also be an issue, since it would be less likely to be built with a posture of heavy validation. And in any case, the average user would rather just run on vibes rather than taking all these paranoid precautions. Then again, what do I know, maybe free-wheeling agents really will be everything they're hyped up to be in spite of the problems.