I agree. Anecdote: The difference in treatment between a permatemp ('seasonal' worker at an entertainment facility working more than 9 months per year, later round-the-clock) and F.T.E. is massive.
In the former, you are guilty until proven, if not innocent, then merely suspicious.
In the latter, you are innocent until proven guilty or more commonly incompetent.
I'm glad I work at one of the latter places now.
Maybe people would be less hostile to the idea if you didn't dismiss the fruits of their labor with accusations of "privilege." It's kind of insulting to be told that you effectively didn't earn part or all of your success because of your race and/or gender.
I'm not trying to say that the status is unearned, either, but I see why developers wouldn't want to agree with me. It's not humbling at all, and can appear arrogant.
This made a lot of people uncomfortable (software engineers didn't want to acknowledge the privilege they've been living with and non-software folks interpreted it as bragging). I think it must be pretty tough to understand the gap unless you've been in both.