Yes, a lot of people would identify as a "black" person, but their skin colour would probably more accurately be called "brown". Personally I think the more correct term is African-American, but people choose to be offended by "black" when used in words even though it relates more to the colour than a skin colour like you said.

Overall I think the logic of opposing words like "blacklist" just falls apart logically in multiple areas and I think your explanation is a good example of why.