A common refrain against any attempt to mitigate unjust effects of past racial injustice (affirmative action, protesting against unjust policing, DEI, etc) is that the mitigation itself is racist, and the best thing would be to treat everyone "equally" going forward. Thus the "all lives matter" and "we welcome everybody regardless of race" are the same coin.