News for hackers. Stuff that matters.
Re:Garak, LLM Vulnerability Scanner by brookst on Sunday November 17, 2024 @11:38AM (#42165080)
Great writing style on the README. It’s always nice when a corporate tool has docs that were obviously written by people who are having fun at their jobs.
Re:Garak, LLM Vulnerability Scanner by xwn on Sunday November 17, 2024 @11:52AM (#42165195)
Thanks! Wrote it loooong before it was a corporate tool and was only a labor of love. Now it's both
Re:Garak, LLM Vulnerability Scanner by sdesol on Sunday November 17, 2024 @03:04PM (#42166697)
I ran the README across my tool and found 9 spelling and grammatical errors. You can review the errors at https://app.gitsense.com/NVIDIA/garak?doc=aad3f6b90464. I can create a pull request if you want.
Re:Garak, LLM Vulnerability Scanner by sdesol on Sunday November 17, 2024 @05:37PM (#42168000)
I guess I was a bit direct but I don't fully understand the down vote. I was not implying that the README was bad and it does have corrections that would improve it. My reason for not raising a PR is some repo owners don't care and I really didn't want to go through the effort unless they actually care.
Re:Garak, LLM Vulnerability Scanner by cortesoft on Sunday November 17, 2024 @11:33PM (#42169731)
The downvotes were probably because the comment felt like an ad for your tool
Re:Garak, LLM Vulnerability Scanner by squigz on Monday November 18, 2024 @03:39AM (#42170761)
This, and nobody asked, and it was irrelevant to the comment thread.
Re:Garak, LLM Vulnerability Scanner by retrovrv on Monday November 18, 2024 @01:28AM (#42170235)
This is actually pretty cool. Would love to try it!
Re:Garak, LLM Vulnerability Scanner by sdesol on Monday November 18, 2024 @10:25AM (#42173195)
Expect to be able to try it by the end of this month if I am lucky. It will be a simple one line docker pull command or if you want to install it, use npm.
Re:Garak, LLM Vulnerability Scanner by Ldorigo on Monday November 18, 2024 @01:48AM (#42170330)
Also, FYI, the majority of "errors" found by your tool are not actually errors.
Re:Garak, LLM Vulnerability Scanner by sdesol on Monday November 18, 2024 @10:21AM (#42173147)
Yes I agree if the prompt that was used was less strict with regards to verb tense, prepositions and so forth. I wrote this prompt for use for technical writing, which may not fit the style of the author.