Encryption is OK but I'm more interested in simple privacy.

Privacy as in only approved addresses are allowed to send me email. If an address is not approved, it gets rejected at the server. This would solve the single biggest issue with email without requiring much in the way of added operational complexity.

Discuss amongst yourselves.