> It's not a "differing and diverse political opinion" to think people of color and women are inherently less worthy, it's just racist/sexist.

It actually is both, which neatly answers the "why are you against diverse political opinions": Saying something is 'just' an 'opinion' doesn't absolve it from being racist/sexist.