It depends on what protects the key. If the problem is being unable to duplicate it, you could protect remote access with a different YubiKey or some other second factor.

And the setup in the article isn't even remote access. If the only way it can be triggered is a local button press, you're golden.