This is the best advice. And even within large companies, choose teams that will grow. If your team and org all grow you too have a very high chance of growing. If your Director/VP is not growing/getting a bigger org, your own growth chances are inherently limited for very senior roles.

It becomes a bigger risk/reward scenario for joining companies.