Re:Who Will Test the Tests Themselves? (2017)
by drewcoo on Monday September 07, 2020 @05:18PM
(#24402997)
The Wikipedia article states "fuzzing can be considered to be a special case of mutation testing." I'm not sure I agree with that. Regardless, that does not mean "mutation testing is a generalized form of fuzzing."
Normally, fuzzing is done from outside an interface to verify that the interface works and the code behind it doesn't fail horribly. Normally, mutation testing is done from behind an interface to verify that the tests are doing something. Compared with typical unit tests, they may seem similar with their use of randomness or ASTs as machines determine what to test and in that they are not functional tests, but they are very different things.
Re:Who Will Test the Tests Themselves? (2017)
by sitkack on Monday September 07, 2020 @11:18PM
(#24404928)
Both are mutation, I feel like this is splitting hairs, interior vs exterior. It doesn't strike me as very different. What would be some other examples?
Normally, fuzzing is done from outside an interface to verify that the interface works and the code behind it doesn't fail horribly. Normally, mutation testing is done from behind an interface to verify that the tests are doing something. Compared with typical unit tests, they may seem similar with their use of randomness or ASTs as machines determine what to test and in that they are not functional tests, but they are very different things.