By default wsl2 grabs half of the memory, but that's adjustable. The biggest pain point I have is to run servers inside wsl that serve to non-localhost (localhost works auto-magically).

I am surprised you had such problems with wsl2 graphics acceleration. That just worked for me, including CUDA accelerated workloads on the linux side.