Nouveau drivers are pretty terrible (performance-wise) and didn't support the card that I am using last time I could find any real info about it (admittedly more than a year ago, I use a GTX 1070). This uncertainty is a fact of your life if you use nouveau, which is precisely not what I'm looking for on my main workhorse machine.

This is leaving aside all of the trouble that you have with running Nvidia's ML stuff when you don't use their own driver (impossible, AFAICT).

Both of those things are blocking issues for me, which in turn means that using anything that doesn't support regular nvidia drivers is a no go.