Sounds like these issues are caused by the nvidia driver, which I thankfully never had to deal with, and the Steam Deck won't use that either.