I would recommend looking at Design of Experiments methodology using Pairwise or Fractional Factorial methods combined with some form of automation.

https://csrc.nist.gov/projects/automated-combinatorial-testi...