I would generally agree that any instance of discrimination by characteristics orthogonal to the performance of a given task is undesirable (if we're striving to optimize total societal benefit / output / productivity).

Attractiveness is another axis of discrimination which is frequently orthogonal to job performance (unless we're talking about jobs as a model, etc).