If your goal is to create a society where relaxed human interaction is prioritized, then it would be deeply inefficient to accrue the majority of surplus resources to a tiny few.

If on the other hand, you are a member of elite whose interest is in competing with other members over resources, you would define efficiency in a way that minimizes the value captured lower down the hierarchy.

So yes, I am essentially saying that, but I don't want us to fall into the trap of using a single definition of 'efficiency' based on the assumptions of a particular system, but recognize that it depends on what is being optimized for.

I don't think that relaxed human interactions work against the elite's goals per-se - they just don't contribute directly to their goal and so are optimized away wherever possible.