I am not white, and indeed, discrimination based on skin color is much easier to shrug off for me, than discrimination based on thoughts or beliefs. I think it's because I equate my identity to my thoughts and beliefs, and not my skin color. This perhaps also comes from stoic philosophy, i.e. I don't bother to think about things I can't control such as my skin color.