Heinlein embeds too many weird sexual themes in non-trivial ways in his stories.
Culture is too difficult to convey in a movie. The relationship of the AIs to the humans in particular is too subtle to come across well, and it’s too easy to make it into a giant party with occasional inexplicable violence.
Didn't seem to be a problem for A Song of Ice and Fire.
And GOT is pretty tame, sexually, compared to what Heinlein stories got up to.
Incest is a little spicy, but those are the villans so it's a bit more accepted, and the rest of GOT is mostly just a flash of tit or dick now and then, right? More titilating than conceptually boundary pushing.
Heinlein had, off the top of my head: a main character forgiving and falling in love with her rapist, mother/son incest including protagonist, big ol' family incest (more complicated and varied than I can remember the details of) including "the good guys", a transexual protagonist (including many, many sexual descriptions), many varieties of open relationships, more forms of group marriage than I've ever heard anywhere else, and a sex cult (started by the protagonist).
Most of those you could probably leave out of whatever story without too much trouble, but they're not exactly small parts of their respective stories either.
Still, I'd think someone could make a really good movie/show out of at least: Friday, Double Star, The Moon is a Harsh Mistress, probably a few others.
Even some of the others... I mean, they made the Handmaid's Tale, and that's way more distressing than most of Heinlein's Weird Sex Stuff.
Matriarchal, multi generational polyamory is going to be a bit weird for half+ of society, and it’s not easy to remove that without completely rewriting almost the entire book and it’s characters.
Like, it might not be for everyone, but there have been many commercially successful TV dramas with more disturbing sexual content than Moon is a Harsh Mistress. (Now, some of his other stuff...)
GoT style sexuality (including incest in royal families, widespread prostitution, etc.) used to be pretty normal. As in, literally up until a century ago.
A handmaid’s tale (minus the massive infertility issues) is basically harem/sex slaves, which is still going on right now, and has been for most of human history near as I can tell.
The writers know how to push buttons to make that titillating and ‘tehee oh my’ type controversial, which gets eyeballs, without bringing a banhammer down on themselves.
Most heinlein (with moon as a harsh mistress being one of the mellowest!) is more in the alienates-too-many-mainstream-groups category. The large polygamy groups led today are all patriarchal, and would start lashing out at anything matriarchal. Matriarchal groups right now are pretty solidly anti-polygamy, etc.
Star ship troopers might be in the wings for a remake though, with the authoritarian bent society seems to be taking lately, but I doubt the ‘free sex’ angle would play well with the ‘rah rah fascism’ angle. Those two groups currently aren’t as well aligned. And near as I can tell, it would be even harder for people to understand satire than last time, so good luck with that angle.
And no one knows how to turn it into clicks/butts in seats reliably.
So it doesn’t get the kind of attention from writers/producers/money folks. That’s all it is.
PKD has a niche that does reliably put butts in seats, and doesn’t have the same baggage, so it does.
- Objectification and sexualisation of very young women. The main character's marriage-group has a wife who is around 14 or 15. When she dies, there is this disturbing quotation "an explosive bullet hit between her lovely, little-girl breasts." There's a quotation elsewhere that says "She was possibly twelve, at stage when a fem shoots up just before blossoming out into rounded softness."
- Men are portrayed as desperate, lonely, and possessive, and are only prevented from brutalising women by the threat of violence from other men who are just as possessive. There is a bizarre social ritual in which men show their "appreciation" to sexually attractive women by looking them up and down and doing a lot of whistling.
- Women are portrayed as dumb, petty and manipulative. They are often eager to abuse their sexual power over men. The only part that women play in the initial revolution is to parade seductively in front of Authority guards in order to distract them.
- Alienation of homosexuality. It describes men as "turning to other men" if times are bad, but does not countenancne the idea that some men are genuinely (perhaps only) attracted to other men.7
I'm not sure if the actual content is as weird as GoT, but here's the kicker. In GoT I got an impression of "here is a women being objectified, isn't it awful". In MiaHM I got an impression of "here is a women being objectified, isn't it wonderful and totally natural".
Heinlein had a medical condition that progressively blocked blood flow in his brain. He increasingly needed themes that would increase his blood pressure to be able to write at all. He finally got surgery.
Even the Atreides were full on ‘the ends justify the means’, if they did nominally have ‘the good of mankind’ as the goal. Those are the most terrible dictators though.
In the context of the societies being portrayed by the books, these behaviours may be normalized. The same goes for within the context of the personality of particular characters.
It doesn't necessarily mean that the author agrees with them. Personally I'd prefer that authors in general be free to write fiction without having their creativity diminished by worrying about whether a reader is going to think that the author holds the same view.
Another classic trope of his is the "hyper-competent" man, who is incredibly self-assured, is smarter and can do everything better than the average person. Hard to say exactly what drives this, but my guess is it's either a superiority (I'm better than these fools) or inferiority (I wish I was better than these people) complex.
The hyper competent man trope is fairly ubiquitous, maybe part of what drives this one is pandering to the target audience.
And who wouldn’t want to be hyper competent in everything?
I have always felt that they always seem to skirt the edges of plausibility much more than other sci-fi. But I think you are right, the “tech” takes a backseat to the personal story.
Personally, I'd love to see e.g. The Culture novels be made into a show, or series of films. There was talk of making a Consider Phlebas TV show some time back, though I don't think it went anywhere. Heinlein's "The Moon Is A Harsh Mistress" could also do well as a stand alone movie, though possibly with Heinlein you would need to tone down the polygamy themes.
As to why PKD became such a cinematic mainstay I can't quite tell. I would think part of it would be to do with the fact that many of his stories were less about the "lasers and spaceships" part of SciFi, and more about the moral and human aspect, meaning costs could be saved on big budget set pieces ala Star Wars.