"The same crime has a higher price to pay, The judge and jury swear it's not in the face."
"Every February washed away"
"The bell curve blames the baby's DNA, But test scores are how much the parents made"
Not exactly metaphorical. I have no doubt there are people who don't get it. But there are also a million explanations, not only all around the web but also in the comments section itself. But people keep covering up the explanations by asking what the song is about, which I'm sure occasionally happens purely innocently, but in aggregate it's hard to see as anything but a deliberate attempt to silence black people.
Especially once you compare the comments on this song to the comments on, say, Stairway to Heaven, whose lyrics are 10x as 'metaphorical'.
I would say that he perhaps predicts your comment in the song itself:
"Only in the past is what they say [...] Say it publicly, and you're insane"
I don't think that's a charitable interpretation. Whether you're black or white, his song is very metaphorical. The underlying tone can generally be understood, and the lyrics aren't nonsense, but it's difficult to comprehend any of them when taken literally.
Of course it's easy to see that the song is related to the plight of black members of society ("chocolate", school books, prisons, "living in a gate"), but the metaphors he uses are definitely not obvious, nor is his exact message obvious without close analysis of the lyrics.
It's pretty ridiculous to assume someone's confusion is an intentional racist aggression. Also, many people genuinely aren't aware of past and present issues black Americans face, so their not recognizing them doesn't somehow mean they approve of them or are dismissive.