I think the most unusual driver you'll need for the Deck is the controller. There's upcoming mainline Linux support[0], which Steam Controller already has. The default behavior either has it emulate a mouse/keyboard, or requires Steam to act as a driver. There's an open source project to do gyro mapping and all that the Steam client does, and they're working on Deck Controller support[1]

[0] https://www.phoronix.com/news/Steam-HID-Steam-Deck-Linux-6.3

[1] https://github.com/kozec/sc-controller