> I hate that. I've actually put off doing breaking changes simply because I didn't want to bump the major version number

Get over it? It's a number. If you want to base it off a consistent semantic reasoning then do so. Otherwise don't do it at all.