I think that is weirdly pedantic and an abuse of the word neutrality.

Would it help if I said "taking a position of neutrality implicitly supports the more powerful and therefore neutrality supports oppression?"