I built a vulnerable app and spent $1,500 seeing if LLMs could hack it

Re:I built a vulnerable app and spent $1,500 seeing if LLMs ... by danpalmer on Wednesday June 03, 2026 @09:47PM (#48392647)

What a joke. Must make it pretty easy to poison a session, you don't need to persuade the model about anything, just trigger its security controls, ideally after as much context as possible, but before it has generated any useful output.

[ Parent | on HN ]

Re:I built a vulnerable app and spent $1,500 seeing if LLMs ... by kay_o on Wednesday June 03, 2026 @09:55PM (#48392686)

After all, what is roleplay or games but a jailbreak of guard rails? :]

I've even had it refuse CTFs knowing it is a CTF with blatantly obvious CTF flag, no actual application

[ Parent | on HN ]