A lot of these expenses fulfill a necessary function for wealth-building: they are social signifiers. A lot of financial opportunities---particularly job offers---come through one's social network, and things like dining out are important elements of maintaining social connections.

Others, like fitness, clearly have the capacity to pay off financially in the form of reduced health expenses and increased capacity to work.

That doesn't mean it should be your sole reason for doing these things---enjoying a fine meal with friends, or having a good workout are gratifying in their own right, and if you're engaging in them just for the possible financial benefit, you're missing out on life. But they are not the financial drag they may appear to be at first glance, either.