It'll never work. Because it is accepted that "diversity" is a good thing, without question. So you could argue with stats to prove you're doing merit-based hiring only. But then they will force to you "measure" that merit against a nebulous term or benefit such as "racial/gender diversity".

Edit. Removed stuff about types of diversity; not relevant.