Is it? Humans are tribalistic. Family, town, sports team, etc. The further out you go, the less typical people associate "them" as "us." I'm not sure that it is non-westerner's race nor skin color as much as distance, culture, and lack of media exposure. Doesn't make it right, but I'm not sure it is racist.

Sure, it's trivially easy to slip into tribalistic behaviour. That doesn't make it right, decent or defensible. We should aspire to be better than our unchecked nature; not use it to excuse our failings.