Religion or Veteran status* are obvious counterexamples, people are very much in control for those.

Point is, just because an outgroup can be discriminated (legally) it is not fair morally.