I got a similar idea recently. I was getting annoyed by the coding agent, running on my laptop, being unable to use sudo (with my supervision) when ssh-ing to my remote server. I wanted to build this as a PAM module. I started building this but then I found it already exists, and I use it happily: https://github.com/z4yx/pam_rssh