Just because they are considered a group. Our group is "the people", their group is something less. It happens with completely random groups, and when there are racist, sexist etc. excuses they are only a way to make oppressors feel right.