The concern is that there are places where minority hires are explicitly a lower bar, so those people get junk jobs and layoffs, regardless of ability.

Personally, I think the problem should be pushed upstream whenever possible. (More funding for minority elementary and high schools, and candidate quotas for recruiters but not hires both are good examples of effective approaches).