If you assume your figure of 12%, that means 1 in 10 people identifies as black. I would not consider that "very rare."
As of 2015, there are ~20 million Asians in America. It would be weird for me to agree with the statement that asians are "very rare."
http://factfinder.census.gov/faces/tableservices/jsf/pages/p...
Anecdotally, growing up, there were a half-dozen Hispanic kids (who were my cousins, as my great-uncle had married in Arizona when he was in the Army), one (adopted) black child, and one other (adopted) Indian child. That was the sum total of the ethnic diversity in the entire thousand-person school district in one backwards corner of Maine. We had to rib on the French-Canadians and fall back on home-town stereotypes... There were actually more Asians around, because the Boston Chinese food restaurant cartels/mafia expanded northward. I never met anyone who was Jewish until I went to college.
etc
When I got to college in Chicago, though, I was surprised that for most of my fellow students' high schools, black people numbered in the single digits.
Closer to 1 in 8, actually. But that's nationally -- the US is a big nation with lots of regional (both large- and small-scale) variation. Its under 7% for California (and SF is pretty close to the statewide ratio, though neighboring Oakland is close to 30%.)
Actually, in a lot of places they kind of are: a little over 12% of the population, very much concentrated in the Old South states and a relative handful of cities almost all east of the Mississippi. (Six percent of San Francisco's population as of the 2010 census, if you're wondering.)