Re:Fuzzing Perl: A Tale of Two American Fuzzy Lops
by moyix on Sunday August 21, 2016 @01:27PM
(#12331756)
I think that's right for just picking a different PRNG seed. When you start looking at modifying the search heuristics, mutation operators, or other parts of the "strategy", you definitely start finding different bugs, though.
Re:Fuzzing Perl: A Tale of Two American Fuzzy Lops
by hannob on Sunday August 21, 2016 @01:42PM
(#12331817)
Yes, absolutely. Different strategies can lead to vastly different results, often it's subtle things.
Good example: There was a bug I found in openssl that Libfuzzer was unable to find. The Libfuzzer developer was quite interested in this and has now adopted new mutation strategies: https://github.com/google/sanitizers/issues/710
You'll get some fluctuation, a bug may come up half an hour earlier or not. But results tend to be pretty reproducible. If you find a bug with a specific test and tool in x hours then the next time you try for at least x+1 hours you'll find it again.