The problems like "inequality" did not happen because we had equality. They arose because we had discrimination. Many of the same people who rail against guidelines that encourage more neutral language also don't agree that "the only cure to the past discrimination is present discrimination".

It does not sound crazy to me.

Yes it doesn't sound crazy because you're not describing reality - you're describing the fictional world where you are being victimised because you're not a minority. This line of reasoning is a favourite with white supremacists and "actually it's racist to try to address racism" is the first step on that road.

>also dislike things like affirmative action, scholarships for minorities, investment/stimulus in poorer areas or other governmental support for poorer people.

In my experience, the "Don't help poor people" and "Don't be racist when supporting people" are not the same group.