Being the defacto windowing system for a platform that has very little desktop market share isn't a great success.
Being the defacto windowing system for the most popular operating system family is a great success.
And if you believe Windows is the most popular OS family, then being the defacto windowing system for the second most popular OS family is still a great success.
Actually the defacto windowing system for desktop Unix is OS X's window manager, based on Quartz Compositor.
Commercially speaking, X11 was a great success. It is the de facto windowing system for UNIX and UNIX-like systems despite all of the horrors it brings.