Statistics do not work like this. You either positively reject the null hypothesis (i.e.: "these things are different") or you fail to reject the null hypothesis (i.e.: "I cannot assert these are different").
Formally speaking, I am doing the latter.
Informally speaking, everybody else understood my point as a rebuttal to OP's. More explicitly: "claims of X seem grossly exaggerated" should be taken as "I haven't seen compelling evidence for X" -- it may be awkwardly phrased, but I suspect you know exactly what I meant.
You can also just outright swap around your null and alternative hypotheses for a frequentist-style test. For example, your null hypothesis could be "proportion of women to men is 0.1" and your alternative hypothesis is that it isn't, for a standard two-tailed test.
If things are not equal, you can still prove that there is no bias by asking the disadvantaged group for their opinion. It's not like polling this group is impossible.