I don't usually RDP to machines withing reach of me, I would prefer to use a KVM. Also I usually keep a security key in my local machine.

But I guess for convenient monitor sharing it could be useful to RDP into a machine within your reach.

What is likely an actual problem though is if your security key uses U2F and you have it plugged into your local machine.