pgp is fussy to set up, and that matters.

But beyond that, good secure messaging protocols are designed so the recipient can verify you sent a message but not prove that to anyone else.

And they also make it so a compromise of your private key can't be used to decrypt old messages.