As I said, there's a user unit (systemctl --user status podman.socket) that will run rootless just like using the podman CLI without elevation.