I built a vulnerable app and spent $1,500 seeing if LLMs could hack it

Re:I built a vulnerable app and spent $1,500 seeing if LLMs ... by kay_o on Wednesday June 03, 2026 @09:40PM (#48392600)

When your session is force ended for "abuse" you get neither the response nor a refund

Security, games (think weapons, PVP, attacking, etc), sometimes even asking it for a security review of some CRUD code it wrote itself

[ Parent | on HN ]

Re:I built a vulnerable app and spent $1,500 seeing if LLMs ... by bombcar on Wednesday June 03, 2026 @10:25PM (#48392900)

I asked it about a “yellow background cell” in Excel and it spewed a book at me. Then it solved the issue.

[ Parent | on HN ]

Re:I built a vulnerable app and spent $1,500 seeing if LLMs ... by danpalmer on Wednesday June 03, 2026 @09:47PM (#48392647)

What a joke. Must make it pretty easy to poison a session, you don't need to persuade the model about anything, just trigger its security controls, ideally after as much context as possible, but before it has generated any useful output.

[ Parent | on HN ]

Re:I built a vulnerable app and spent $1,500 seeing if LLMs ... by kay_o on Wednesday June 03, 2026 @09:55PM (#48392686)

After all, what is roleplay or games but a jailbreak of guard rails? :]

I've even had it refuse CTFs knowing it is a CTF with blatantly obvious CTF flag, no actual application

[ Parent | on HN ]