If a company sends me mail and I don't remember allowing them to, I will not trust them and will not use the unsubscribe button, because using it signals to the sender that my address is valid. I will mark as spam.

The onus for clearly communicating that you are going to mail me anything other than transaction updates is with the sender, not the receiver.