I do not understand your analogy. Are you implying that we cannot be unbiased? I do agree with that, however, what is this diversity thing, fighting over biases or preferences (sides)? I do not understand how one side is bigotry, and the other is equality. It seems like it is just a matter of POV. When you are steering to the left, the right is in service of bigotry, and when you are steering to the right, the left is in service of bigotry. Additionally, according to your analogy, it seems like that everyone - including the people who say they prefer "equality" - is actually not steering straight, just to a different side.

It would be great if the people who preach we should not discriminate based on ethnicity, religion, and so forth would actually stop doing that, and start paying more attention to skills, which is actually more relevant to the job. It seems like that they do not wish (or at the very least do not, regardless of intent) to stop discriminating, they just steer to a different side.

Because one side attempts to ease societal bias by including folks often overlooked. The other attempts to perpetuate this system, keeping an underclass.

The old tired argument that "It's just another sort of bias!" is bankrupt. Its a sort of bias that seeks to repair real problems, not keep them.