Important to reiterate this, since it's an interesting feature - borg does, indeed, allow you to store the encryption key for your repository inside the repo itself and you just need to remember/safeguard the passphrase.
I can't say whether this is a good choice for any particular use-case but I appreciate that it is an option ...
For those that are curious, yes, you can later export the key from your repo so that you have a copy elsewhere ...
Anyway, my "home burned down rescue bundle" consists of a flash drive with a keepass export of my password vault and encrypted borg repo key / rsync.net ssh keys at the office.
Slightly less accessible in this pandemic world, but no safety deposit boxes needed.