What you're saying makes sense, and I don't think anybody would disagree that having a diverse PoV on a project would be beneficial. In practice though, organizations saying that they strive for diversity normally don't bother to look any deeper than skin color and gender. That's one of the common criticisms of big tech companies; they claim to value diversity, but they still mainly hire people from a handful of top schools, creating a largely homogenous culture that share a similar PoV, but they say that they're diverse just because a lot of their employees have different skin colors.

As an example, I'm a white male without college experience, raised in a single parent, lower income household. Most people hiring for "diversity" would overlook me just because I'm a white male, but would welcome my wife's vietnamese friend, even though she comes from a wealthy background and went to a prominent school that makes her much less diverse culturally than their existing employees.