This legacy hampers Android too, which is a joke when it comes to multimedia APIs compared to the oligarchic iOS.
In many ways, OS X has shown us the ideal distribution. It's based on open technology and continually adopts new technology as it proves itself, but Apple is not afraid to integrate tightly and replace components with well-engineered, well-tested replacements as necessary (the origination of the divergence between X11 and Quartz), as long as it means a solid, unified, consistent and functional experience for their users.
We need that now. Canonical fancies themselves after that pattern but I don't believe they take the needed organization seriously enough and I don't believe they have the technical expertise necessary to really make the tough calls and implement a technically-sound user-centric system (see: Mir). They need to get some new leadership in there.
So, in other words, it really is. All you said was just rephrasing the problem as solved.
For one, what's "exceedingly rare" is not getting any sound at all. That doesn't mean you get to enjoy all the features of your soundcard (from mixing panels to 3D audio and such). Or that it work without tinkering in ALL programs and across desktop environments.
There's also the issue of more professional sound work, which will be a world of pain. Getting any pro, multi-channel soundcards to work and such.
For anything else than basic sound playing, from recording a podcast, to streaming, to using a DAW etc, here be dragons.