In the sport of bodybuilding, genetic advantages do make it "unfair" because you are most definitely constrained by it (zipper abs, unaesthetic chest insertions).

But I wouldn't subscribe to this definition of fairness. Fairness seems more about everyone playing by the same set of rules in the sport. If you start including genetics into the rules then it would become unfair, purely by defining it that way.