That sounds like a process where it's very easy to slip up and if that's something to be concerned about in your threat model maybe you should not be doing that in the first place.