If someone isn't qualified, then a small bump won't be enough to put them in the job. We're not talking about picking a random person off the street to meet a quota.

There are flaws in affirmative action, but doing nothing about disparities that have self-perpetuating attributes is a pretty bad plan by itself. Top candidates don't appear out of a vacuum.