I get why you feel like that, I really do, but it all seems a bit hand wavey to me. 99% of the time with semver you can unambiguously tell whether it should be a major, minor, or patch bump (of course there are edge cases though).