News for hackers. Stuff that matters.
Re:100% Bug Free Software with Mutation Testing by adolgert on Tuesday September 07, 2021 @03:18PM (#28448710)
Mutation testing looks really fun until you use it. It has two problems, that false positives and false negatives abound, and that it doesn't scale well as code gets larger. Suppose you modify code, then how long does it take the mutation testing framework to retest the relevant code? On the other hand, mutations can do a good job of estimating test coverage. In particular, they can help to prioritize tests by finding tests that cover the most mutations.
Re:100% Bug Free Software with Mutation Testing by julienmaring on Tuesday September 07, 2021 @03:36PM (#28448900)
I agree with you! I only used it on a minor part of the code such as services. It can help people to understand why they are testing
Re:100% Bug Free Software with Mutation Testing by adolgert on Wednesday September 08, 2021 @02:56PM (#28461537)
"...understand why they are testing." That's interesting. There is an information-theoretic measure for test quality that asks how effective a test is by asking how closely it examines a test output. For instance, does it "smoke test" that the output isn't NULL, or does it look at a returned data structure and enforce invariants in detail. It's the flip-side of asking in how much detail a test exercises the code. Well, keep having fun. Testing is a great way to think about code.