It doesn't take that long to arrive at the conclusion that you should not expose any secret to untrusted hardware.

So creating a one time use key for that computer is probably a good idea, you can revoke it once you are done using it and then it won't cause you any problems in the future.