I hear this all the time, but I've actually never left a manager. I've liked all of my managers. It's usually either some external force like a compelling opportunity or something with the org that is beyond my manager's control.