I find it quite useful. I've been bitten before when a system (Carthage) explicitly decides to be 'semver except that part', for some reason.

All projects take a little while to stabilize, and this simply formalizes (the numbering of) that process. Any project can trivially opt out of it by simply starting with "1", as you suggest.