Even though I mostly take a "white X" as a metaphor for a lack of diversity (of opinions and mindsets), I don't think most people do. These people aren't assholes because they are "white X", they are assholes because they are bourgeois stuck in their echo chamber.
Class seems to be the determining factor, really. Europeans had a couple environmental advantages early on [0] that allowed them to monopolise the world's resources, which were never fairly redistributed.
The current bourgeois are bourgeois mostly because their parents were, much less because they had the advantage of being white when building their wealth. There are of course outliers and ethnicity does have an impact, but overall there is very little social mobility anyway.
[0] https://www.goodreads.com/book/show/1842.Guns_Germs_and_Stee...