Yes it doesn't sound crazy because you're not describing reality - you're describing the fictional world where you are being victimised because you're not a minority. This line of reasoning is a favourite with white supremacists and "actually it's racist to try to address racism" is the first step on that road.