Are you working in a competitive field? I know and have worked with many women and minorities in highly competitive fields (medicine, engineering) where diversity programs were in effect and the idea that there's any kind of stigma or that they could be remotely correlated with a less competent team is simply a joke.