The way this happens today in the real world is that I send you an email with an encrypted zip file attachment (and I make sure I've chose an appropriately secure encryption method) then I call you (or meet you in person) and tell you the password.

Symmetric encryption has ergonomics which are actually easier than asymmetric encryption with the tools we have today.