I think you are right in your suspects - I mostly have 0 problems with WSL2/WSL1 and using it daily and probably spend 50% of active time inside on of that terminal session.

For WSLg, I've played around for 15 minutes, tried gnome-terminal, xeyes and may be something else and disabled it - literally have nothing I'd want to run from Linux gui apps.