Same with telling a woman that doing something "manly-man" style is doing it skillfully.
And even if you know it's going to be taken as humorous, let me give you a hint: it's not very funny. It's just not very good as humor. There is much better material out there if you're going for a joke.
I've been referred to as African American, Afro American, colored, person of color, black, negro, etc. It makes no difference to me personally. Unless intended otherwise, it's just a point of reference.
If, say, someone from another company who's visited your offices for a day later refers to you as "that negro in product development," would it be typical that other people of color would take no offense at that use of language?
I'm curious about it. I don't have that lived-in experience, so all I can do to understand is ask and listen.
If someone is looking to be offended then they will find a reason no matter what is said or how it's said.
Intent is the thing that should be judged, anything else is a foolish way to live and you will constantly find yourself offended.