I've had that experience a few times a few years ago, but these days I don't even enable the "make a backup" checkbox when I upgrade HA.

Things seem to break more if you pull in external software repositories (HACS) but that's to be expected.