On the other hand, in general I almost exclusively read books and blogs because I'm interested in what the author has to say, rather than what I'd like to hear. Cal Newport discusses the idea of craftsmanship in a way I really like. When you're building a table or a bass guitar, there are better and worse woods for the application at hand that have little to do with how the craftsman feels about them. They are, to an extent, impersonal and external to him. A song or a poem, by contrast, have everything to do with the author and little in the way of objectivity about them.
Of course, all of this is a case of finding an optimum balance.
I assume you read mostly nonfiction, then?
When a fiction writer comes up with a plot, or even a turn of phrase that blows my mind, that's one of the best things about reading. Like "how did he think up all this?!"
Typically the answer is: hard work and iteration, and many times not by himself. I think you're partially falling for the fallacy of the singular author completing a perfect work with unflinching vision. IMO this is incredibly rare.
Take, for example, Harper Lee and To Kill a Mockingbird. It's an amazing book. It's a novel that might at once feel effortless and also an unaltered vision of the author. But it's actually the result of years of editing (https://en.wikipedia.org/wiki/Harper_Lee):
> Ms. Hohoff was impressed. "[T]he spark of the true writer flashed in every line", she would later recount in a corporate history of Lippincott.[16] But as Ms. Hohoff saw it, the manuscript was by no means fit for publication. It was, as she described it, "more a series of anecdotes than a fully conceived novel".[16] During the next couple of years, she led Lee from one draft to the next until the book finally achieved its finished form and was retitled To Kill a Mockingbird.
Everything from the narrative structure to the title to characterization is refined, over and over again.
The goal with feedback and subsequent editing isn't the dilution of an author's vision, it's the opposite. It concentrates and clarifies the vision with each successive pass.
Novels are clearly a medium for writing to an audience. Artists, esp amateur ones, think they can write for themselves and still create a novel. They should stick to their journals.
Both approaches to writing are okay, but I think there's something wrong when an author says "oh, I'd like you to read this story, but I don't care about what you think".
One place to get feedback is in writer's groups/clubs. They may not reflect your intended audience as much, but they're also writers and would be better at separating their subjective biases (like not liking sci-fi) from a more objective analysis of the work, looking at things that are common to all writing, esp. fiction (is the writing overly wordy, does the plot make sense, are the characters believable, etc.).
Obviously, you can take responding to feedback too far, but the idea of the artist-in-a-tower-birthing-a-fully-grown-work-whole is an inaccurate idea at best, and a damaging assumption at worst.
Like King says, ignore the outliers. But if no one understands a plot twist, or everyone dislikes something you really like, maybe take another swing at it. Iterate a little more. Creative output is the art of refinement as much as anything else.
(Good editors can also often help substitute for peer feedback)