Probably less to do with being white specifically than simply being a convenient Other, but yes. Most people are great. Some are awful, a few evil. When you stand out, you'll attract the attention of everyone, including the latter, and you'd be wise not to forget that, in all its aspects. The whole reason we were able to survive is that locals looked after us, too, and that's worth emphasizing.

This is normal in many areas of the world.