I agree, it really doesn't. Just look at Linus Torvalds for example. Some people asked him at a recent DebConf [0] what he thought of Debian and Linux distributions and his reply was basically "Oh I don't really care about distributions or systemd, I just wanna install it and get on with my life (i.e. the kernel)".
Everyone has an opinion about Technology X/Y/Z, often strongly held.
But you can't make a usable desktop OS out of opinions. You need a big-picture long-term strategy. There doesn't seem to be a lot of that in most of distro world.
Server Linux has done better because the problem space is (kind of...) smaller and better defined, so strategies and innovations have appeared, and there are clear goals to work towards.
Consumer Linux is like a military campaign advancing in all directions. Everyone is working on something, but - beyond development for development's sake - it's not at all obvious why.
- Ubuntu had a polished GNOME 2 desktop.
- Red Hat Enterprise Linux had a polished GNOME 2 desktop.
- SUSE Enterprise Linux had a polished GNOME 2 desktop.
They were also using pretty much the same components. Since then, we had the MATE/GNOME 3/Unity/Cinnamon split and the upcoming X.org/Wayland/Mir split.
I don't know how the solution to that is the buggy mess of, for example, Gnome on Fedora20 which is a buggy mess.
Maybe I don't want to have to read Learn You a Haskell to configure my window manager. Maybe I hate the whole concept of tiling window managers because I like to have overlapping windows?
You are making a lot of assumptions about what other people should want to spend their time on. I don't want to waste time or brainpower coding xmonad or dwm to behave in a way that doesn't annoy me, and manually setting up a bunch of basic infra like automounting USB keys, when I can just use KDE which doesn't annoy me by default.