I don't think it is always the case. There are many networks which remain small and do not over-grow, but you are less likely to know about them.

Typically, they are constrained by some limitation like being for an offline group or requiring a vouching process to join.