> But instead of spending the money on a house big enough to host those dinner parties, you could host them at a fancy restaurant

That may be plausible for uncorrelated birthday events, but what about stuff like Thanksgiving?

Suddenly the usual third-party hosting capacity just isn't available anymore, and you can't simply merge the houses of all participants.