I can see an argument that correcting for bias isn't "hurting" someone that comes with a preexisting positive bias.

But if that's the argument, then you're not "helping" anyone either.

You can look at it either as removing bias so nobody is helped or hurt, or you can view it in comparison to a 'race-blind' process where it helps some and hurts others.

You can't cherry-pick half of each.