A lot of racial slurs are based on a caricature of people's skin colors. Selecting a color that has historically had that problem and then intentionally assigning it to the target of those caricatures seems, if not malicious, at least completely oblivious.