>today you could set up a system where the whole process is tap two phones together with nfc and confirm

This was actually possible in 2011 or so, and a friend and I implemented it for a school project. How well the ux works depends on whether you want to use a key exchange protocol for the in person communication.