Of course you can, a minority is determined by population. There are other populations to move to where any given human would no longer be in the minority.

This is the same argument being presented here: the employees can just choose to work for another employer.