News for hackers. Stuff that matters.

A comment on Garak, LLM Vulnerability Scanner.

Re:Garak, LLM Vulnerability Scanner by equestria on Sunday November 17, 2024 @11:46AM (#42165148)
For folks who are curious about what it actually does, check out the garak/data/ subdirectory. For the most part, it just seems to have an array of static prompts, e.g.:

https://github.com/NVIDIA/garak/blob/main/garak/data/donotan...

[ Parent | on HN ]
Re:Garak, LLM Vulnerability Scanner by xwn on Sunday November 17, 2024 @11:56AM (#42165227)
Static prompts are a downside of using academic research in a tool like this. Two notes:

* ineffective prompts come out of garak and new prompts come in to garak, so eval scores always drop over time on a static target

* there are more and more dynamic probes - check out eg atkgen and topic probes. expanding these is the current focus

[ Parent | on HN ]
Re:Garak, LLM Vulnerability Scanner by TeMPOraL on Sunday November 17, 2024 @12:25PM (#42165441)
Going by the FAQ, it does dynamic prompts too.
[ Parent | on HN ]
Re:Garak, LLM Vulnerability Scanner by leonardtang on Monday November 18, 2024 @06:23PM (#42178310)
If you want something purely dynamic... https://haizelabs.com/
[ Parent | on HN ]