But it's just removing that causes the problem. Which doesn't seem like an important feature. I almost always keep old values for historical purposes/backwards compatibility with backups.

You can add values without issue.