Also, even back in the day, X wasn't considered the best tech around, at least by some. For example: https://en.wikipedia.org/wiki/NeWS was around.
However NeWS' licensing was proprietary and X won out.
Re:Ubuntu 18.10 Cosmic Cuttlefish Released
by unstuckdev on Friday October 19, 2018 @10:22AM
(#18256898)
Gopher and HTTP had a similar situation. Gopher had a lot going for it, but the future licensing situation was unclear. HTTP was free, clear, and widespread by the time Gopher became GPL.
Suffice to say, quite a lot has changed in computer graphics/interfaces since that time, and most modern *nix operating systems end up circumventing quite a lot of X to offer modern features. Thus X brings quite a lot of legacy debt to the table which can't be easily removed.