So? An attacker's not going to have the private key they were created with, and probably won't have a private key that you have an existing trust relationship to.