"Dark horse" isn't a slur or pejorative in general. It's roughly equivalent to "long shot" or "underdog" or something like that.