GPU passthrough on WSL2 is a thing since around December 2020 -- but I'm not sure if it's in stable yet, I had to install an insider build for it. It works surprisingly well and I was able to develop my ML project using it (with the help of VSCode devcontainers)