When considering political systems, fairness doesn't matter if it causes an unstable system.

Think of it kind of like an organism. Only those that can survive can evolve and pass on their genes.

That isn't to say that fairness is a bad goal, because it's a good goal. But the system needs to remain stable.