I think this is largely it - the whole maker vs. manager thing... when your job relies on focus, being in a situation where you can control distractions is a benefit. But when your job relies on getting others' attention it can clearly be a negative, esp. if the culture is not thoroughly supportive.

It also adds an extra hurdle for those who aren't particularly skilled at management.