Exactly this! A couple of times in my career I've stepped over into management, and regretted it each time, in large part because I can never get to the point where the manager-y stuff "counts" as work; instead it's stuff that gets in the way of doing "real" work, so the job is constant misery.