I mean either you sftp to a shared folder that can be accessed from your regular user as well or you use a staging area with a cron job (or you load/unload the staging area manually.)
I'm not deploying a website so a staging area isn't applicable. This is just a VPS that I use for various purposes.
Set a long password for the user you log in as (correct horse battery staple-style passwords are perfect for such things), and make sure to put SSH on an alternate port to keep the more basic bots away and thereby reduce the noise.
Having to type a long password for sudo promts is a bit of a pain, but that trade-off is worth it from a security perspective.
You mean an RSA private key? (no really, that's exactly what it is... you can put your private key in your password manager and copy it to your computer)
Is there any way to configure SSH to use a custom high-entry password that's different from the user's local password? My local password is something reasonable for me to type regularly (e.g. for sudo prompts), but I'd love to have a super long password just for SSH that I have to copy from my password manager each time.