Any idea what the false positive rate is?
Re:Welcoming Semmle to GitHub
by tru3_power on Wednesday September 18, 2019 @10:08PM
(#21012549)
If you use the out of the box rules for any of these tools the false positive rate will usually be pretty high. The trick is to write custom rules that are more tailored to your code.
So how much is involved in writing the rules, and at the end of it, what is the net false positive?
Re:Welcoming Semmle to GitHub
by tru3_power on Wednesday September 18, 2019 @10:50PM
(#21012788)
It took me a few months to get decent results with a low false positive rate. We haven’t had the tooling in place long enough to give hard stats but our aim is to have a false positive rate of less than 25%. Another great thing that these tools provide (if the results are valid) is that they let more junior members of the team/developers not as familiar with security issues to be able to understand the vulnerabilities found as they display a nice call flow graph/diagram that’s shows source to sink.
You're right though, it's not a panacea, and it could probably be great for other uses too.