I think most people prefer kanban or scrum over traditional PM style management.
However they have failed deliver on all promises.
When people complain about agile, they aren't harken back to traditional pms
I am not against some shuffling of responsibility. But ideally, you should know why you do it and best if it's backed up by some studies. You can't do a study if there is no way of comparison.
It's not just people though, it's also stories, sprints, iterations, epics,... you name it. Also, everything that came before was retroactively (and derogatorily) renamed "waterfall", despite the fact that many of the advantages of agile were actively discussed since 1960s.
And, yes, I believe well managed project can be better than agile, at least in some cases. We have Agile in our organization, ostensibly, but in effect it's lot more paperwork than it ever was under so-called waterfall. At least that is my experience, of course some other people can have different one. Maybe you just didn't get in the contact with the right snake-oil salesmen - good for you!
But, what I think is crucial, is (at least for someone) to know the history. So if the scrum master is to successfully improve the process, he should have a clue about project management and what was tried with what result. Otherwise he will just rediscover Brooks (Fred, although Mel is probably also a possibility). And that's why it's bad to say things like you are saying, that scrum master is not project manager, because then you will get people who really have no clue.