Just worked? The amount of security advisories for Nvidia kernel module or Nvidia X module are staggering.

X is also insecure from the ground up, that alone is enough incentive to move away from it.