Probably because nobody wants to put opentype font rendering and input method support and various other things from a window system into the kernel? This stuff all has to be in userspace so you're better off just running a minimal X or Wayland server at that point.