I think one of the factors is romance -- SF writers want certain things to happen and just wish it into being, regardless of how plausible it really is (faster than light travel, time travel, anti-gravity, artificial gravity, laser pistols).
On the reverse side they tend to ignore technologies that are either unromantic or make stories more complicated or seem to fight against cliched dramatic opportunities. (Fast travel adds to romance and drama, but fast communications detract from romance and drama.)
And I would dare to argue that the AI is at the beginning of the s-curve. The field of study have been around for many decades already, many applicable results found and it is used in the industry. It's kind of like saying that current transportation technology is at the beginning of the s-curve, because I am waiting for near light-speed transportation, and current speeds are very small compared to my arbitrary expectation.
Though you're definitely right that literary biases play into it. While not not all SF writers are futurists, most futurists are trying to tell stories. Even some who aren't primarily SF writers: Kurzweil has a narrative arc to his ideas.
And of course, which technologies the futurist is personally familiar with can vary widely. Asimov, for example, had a blind spot for robots.