Because one side attempts to ease societal bias by including folks often overlooked. The other attempts to perpetuate this system, keeping an underclass.

The old tired argument that "It's just another sort of bias!" is bankrupt. Its a sort of bias that seeks to repair real problems, not keep them.