could the problem be the exposure level? to get good contrast for the details in a face with darker skin you need to use a longer exposure, which would blow out light areas in the background.

(i agree it could also be that it was trained on white faces)