For wargaming I think what happened is that “special dice and more detailed simulation” moved into “computerized simulation” (which allows a lot more depth with less player-managed overhead) in the late 1980s through the 1990s, and most of that whole end of the hobby left the tabletop world.
Personally, I confess to finding complex simulations (whether of the board game or flight/combat genres) more appealing in theory than I do in practice.
If you end up just going "We think it's about 100 meters" that's a lot of effort for not much reward.
Games you mention are still made, but they're a niche product in a niche market.
Needle moving growth for the tabletop industry comes from introducing new people to the hobby, not from selling another Space Marine model to an existing gamer. It's difficult to build a sustainable tabletop business without one or two big hits (ex: Days of Wonder's "Ticket to Ride"). It's even harder for companies that sacrifice usability for realistic simulations.
An argument could be made that the D6 is more readily available, but this is probably irrelevant in the context of miniature gaming: miniatures themselves are NOT "readily available", and you can get the specialized dice from the same store you get your miniatures!
That being said, I fell deeply in love with the classic D&D polyhedra the moment I first saw them. Platonic solids are cool! They're delightfully arcane and geeky. They complement each other in a set. I wish the weird d8 and d12 throws came up more often.
Perhaps there's a lesson here for UX in general: sometimes there's a tradeoff between being _simple_ and being _interesting_, and (particularly in the world of games) it's a tradeoff worth taking seriously.
I prefer the d12 to the d6 for generic rolls, as it allows for the least number of sides with the most human-usable fractions (25/50/75%, 33/66%, and "a little less than 10%").
I share your love of D&D dice :)
Nowadays, for whatever reason, I see a trend back to the humble d6, both in historical wargaming and fantasy skirmish games. Many wargames use d6 in disguise (see: Bolt Action, SAGA, Warhammer). I think it has to do with two things: the d6 is readily available (though, one has to wonder, why is this an issue when everything else in wargaming isn't as easy to find, like the miniatures and tokens!), and the other fancier dice didn't pan out in practice.