News for hackers. Stuff that matters.
Re:Garak, LLM Vulnerability Scanner by xwn on Sunday November 17, 2024 @11:56AM (#42165227)
Static prompts are a downside of using academic research in a tool like this. Two notes:

* ineffective prompts come out of garak and new prompts come in to garak, so eval scores always drop over time on a static target

* there are more and more dynamic probes - check out eg atkgen and topic probes. expanding these is the current focus

There are no comments on this comment yet.