Yes, but even well designed games (from a gameplay pov) can have unexpectedly powerfull builds, like what happened with Starcraft 2 and the genetic-algorithm build order[0]. So simulating builds/gameplays can give you another edge at detecting strange/powerful scenarios.

I also think you should rely on player feedback and community to spot this kind of things, but that could become time consuming if you're a lone developer.

[0] http://lbrandy.com/blog/2010/11/using-genetic-algorithms-to-...