Key escrow doesn't change the fundamental mathematics behind the key. It's entirely an implementation detail / matter of trust. You're sharing what would otherwise be a secret with a new party. If they are untrustworthy or get compromised, it's no different than if you got compromised directly. But now you have roughly 2x the exposure.