Except it's obviously not a wealth issue. Even poor Norwegian people can visit Norway, because they're already there. They probably don't mind poor Swedes much either. Tourist hatred is almost always rooted in xenophobia.

>especially outside the US

Funny of you to assume US is somehow more racist than the rest of the world.