If you can still access your backups after changing your password, you don't control the keys.

In other words, if you can ever actually use something, it's probably not secure.