So it appears that our evolution as social species has set some hard boundaries. Abstract ideologies can go beyond them, of course, but their real-world success seems to correlate to some extent with how much they do or not - I would argue that ancap definition of "fair" is so unpopular precisely because it's so out-of-bounds wrt our biology.
And, in practice, there are large groups of people who do share the broad definitions of "fairness", and therefore saying that something is fair or unfair is useful to communicate the idea within those groups. This is not something that people really like to see put quite so explicitly, but when we say something "this should not be so because it is unfair", it carries an implicit "... and I don't care what those who disagree with me about what 'unfair' means think".
Insurance companies do this sort of thing all the time.