An interesting anecdote was that I led Engineering for a startup that was acquired by a large ($50-100 Billion) company. After we were acquired, several people commented on my collective team as being the "most diverse" in the company. That was nice to hear, but (for me) the most gratifying part was the team members taking stock and collectively thinking "oh yeah, I guess we are diverse!" It happened on purpose, but with the intention of using diversity as a source of strength not as a means of checking off a box.
One of the other things worth considering is that failing to comply with checklist-driven diversity can land you in court for supposed discrimination, where the traditional metrics matter quite a bit and other approaches matter not at all. Between liability and ease of implementation and measurement, it's definitely going to be privileged over other approaches.
The broader, more complex concerns you point to are difficult to measure and thus perhaps more likely to be given short shrift.