Often this argument isn't really about whether everyone is collectively 'better off' by some particular metric. It's about how much of a nanny state it takes to get that result, and whether that's contrary to the spirit of freedom of association. In other words, money is not the only value. Liberty itself is a value.