One hacky solution is to use run a VNC server on your desktop and connect to it locally. Then you can connect to that VNC server remotely and access all your stuff.

The issue I ran into was with multiple monitors. Stretching a VNC window to span multiple monitors is doable, but the window manager in the VNC session won’t know where the borders are and will treat it as one giant monitor. Using one big monitor is a workaround.