Do white-passing gay people not get to have a say in diversity issues?

I really don't like this trend of painting everyone with white-ish skin as a homogenous oppressor class. It's pretty clear to me that a diversity department that explicitly bans white people from leadership positions will not represent my interests if I am discriminated against.