RDP is over network, which doesn't work well if your need to access a machine that doesn't have a working network stack because you're troubleshooting a hardware failure, early boot failure, OS provisioning, etc.

KVM can also be nicer than RDP for certain multi-box workstation setups that need high bandwidth and low latency.