Agreed. I'm not saying everything is black and white. It's a generic concept.
>use of "majority" when the intent is to refer to the structurally-favored class is problematic
Not that kind of majority.
http://en.wikipedia.org/wiki/Majority_%28sociology%29
A minority group is a sociological category within a demographic. Rather than a relational "social group", as the term would indicate, the term refers to a category that is differentiated and defined by the social majority, that is, those who hold the majority of positions of social power in a society. The differentiation can be based on one or more observable human characteristics, including, for example, ethnicity, race, gender, wealth, health or sexual orientation. Usage of the term is applied to various situations and civilizations within history, despite its popular mis-association with a numerical, statistical minority. In the social sciences, the term "minority" is used to refer to categories of persons who hold few positions of social power and whose position in society is underprivileged.
Insofar as their is real privilege, it belongs to those whose desires align with the role assigned to their class, but even that notion of privilege has some danger, because to a certain extent those desires can be shaped and constrained by the structural bias.
But, more to the point, simply asserting that any argument against the existence of privilege by those in the class asserted by those claiming to be advantaged by a structural bias is invalid because part of the concept of privilege is that those who hold it are often unaware of it is fundamentally flawed.
(Also, the use of "majority" when the intent is to refer to the structurally-favored class is problematic; apartheid South Africa is a good example of this problem in regard to discussion of racism, but its a problem with sexism, too, unless you are asserting that the female sex is the structurally-advantage group, which is inconsistent with your reference to male privilege.)