> I've never quite understood, over 30 years of experience in software development, what problems Waterfall presented that warranted a complete refactor...

Because layers of management who need to continually justify their existence can never, ever keep themselves from putting their big fat thumb in the pie and fucking everything up.