I don't think it's funny either. I am a black person, and plenty of white people have been traumatized by their experiences (or lack of experiences) with black people. It's also not "immoral" to be afraid of anything, it is uncontrollable.

Don't avoid a direct, clear question by painting it as non-serious.