Without affirmative action, all thats left is meritocracy and nepotism. So, I imagine an increasing number of black people and women (or anyone else perceived as less deserving) will be seen as "friend of the boss" or "the boss is doing them a favor". Either way, those can be easily addressed and therefore better than being forever labeled as a diversity hire (aka naturally inferior).