There's a kernel:user space split of Linux GPU drivers as well. Mesa, libdrm, libgbm, all have hardware-specific junk in them last I checked.

The kernel drm/gpu side is all about mode setting and managing resources.