In high school, I definitely kept password-protected private keys on a USB key that got plugged into whatever machine happened to be available. (Now I am affluent enough to carry around a real Security Key and a trusted laptop.)
If you were the maintainer, would you really want to change the defaults and deal with the backlash of complaints from users who do copy keys around?
How do I install it?
Is that method actually more secure than carrying around an encrypted key?
Single use login codes on paper probably the easiest way around the problem. https://www.digitalocean.com/community/tutorials/install-and...
Also, you can configure the google-authenticator TOTP module to request key and token IIRC. GA also has OTPW backup codes.
So creating a one time use key for that computer is probably a good idea, you can revoke it once you are done using it and then it won't cause you any problems in the future.