Your last paragraph is basically the gist of it. Managers who make an impact are recognized as such by their team. They manage the team to do their best work possible.

The model of manager as a babysitter is, I think, what happens when an organization gets to a certain size. Once the organization gets big enough, management becomes a vehicle for bureaucratic surveillance. At that size, an organization uses managers to give a human face to bureaucratic machinations.