You can use mutation testing[1] to automate this. E.g. pitest[2] for Java, or golang[3].

[1]: https://en.wikipedia.org/wiki/Mutation_testing [2]: http://pitest.org/ [3]: https://github.com/zimmski/go-mutesting