Except no one is talking about disadvantaging people of a certain skin color (white). We're talking about trying to help bring everyone else up to the same level.
As someone with white children applying for college, I can say without question that skin color is used to disadvantage certain people.
If the fix is "lay guilt upon and attempt to disadvantage all people of a certain skin color because some of that skin color have had an easier time in life", then it doesn't seem like much of a fix, does it?
Racism and bigotry need to be wrong in all cases or the moral authority against them is diminished.