Actually, yes you do. Unless encryption is everyday and used for mundane messages, it becomes a label that says: "Target this guy and his encrypted traffic."