> If you encrypt it, you have to, at some point, also send the keys to the user.

Not if you're using a public key cryptosystem and the user generates their own private key. Only the public part is communicated (from the user to the source of the information), and that isn't enough to decrypt the document.