You’ve largely missed or ignored my point. If you change the game your AI either fails to adapt or adapts in an AI way. But it can’t reliably adapt in a human way without data on how humans adapt to the change. That’s just not how it works. Maia won’t mimic humans hypothetical behavior if you make it so that bishops can also move like knights.

There’s nothing wrong with using bots in play test data but you shouldn’t ever expect an optimization algorithm to generate fun balanced game mechanic stats based on their behaviors by tweaking things until the bots are evenly matched.