No, they're not. A child may benefit from the privileges of parents' favoritism, it doesn't imply that her siblings are oppressed.
Privilege and Oppression are 2 distinct coins with 2 faces each. There's privilege (+1) and lack thereof (0), and there's oppression (-1) and lack thereof (0).
Being well aware of your privileges won't necessarily make you see people in "the norm" as victims, but it may give you pause when trying to form a hasty opinion of them.
Unfortunately, as stated, it's much harder to recognize one's own privileges, than it is to identify a form of oppression. So people keep presuming to know what everybody else should be, should do, should think, should eat, etc, because they presume that the apparent lack of prejudice signals a levelled playing field.
What's scary about privilege is that it's usually invisible.
I think it's fair to say that the majority of humans experience both prejudice and privelege, albeit of radically different quantities and qualities. But while we can't help but be keenly aware of the former, the latter tends to hide itself in our definitions of "normal".