Even with Star Trek beyond TNG, the show fundamentally reflects Gene Roddenberry's ideas of what a post-scarcity society (symbolized by the replicator) looks like. Unlike our society that prizes money as what others judge you based on, in Star Trek, there is no money. People have the right not to work if they don't want to, but to gain prestige you need to contribute to society by joining Starfleet where values like morality and heroism are highly prized [2].
[1] http://edteck.peterpappas.com/rothberg/fictionisalie.htm
[2] https://www.goodreads.com/book/show/27040338-trekonomics
Also, I would say that the "beginning, middle, end" model is a rather superficial framing. Take the Homeric works like the Iliad, for example. It starts right in the middle of a massive conflict that leads to the Trojan War (in media res). A new reader actually has to spend some time reading to get context as to what the hell is going on, and why.
Also, novels are not the only forms of fiction. What about plays and short stories, or even songs?
She loves you, yeah yeah yeah
She loves you, yeah yeah yeah
She loves you,
and you know that can't be bad!Regarding Star Trek and post-scarcity, I can only say that not everybody is convinced by what it canonically presents itself to be:
http://www.stardestroyer.net/Empire/Essays/Trek-Marxism.html
It runs on magic and nonsensoleum (replicators, transporters and free energy, none of which can exist in the real world) and the unjustified assumption that humanity will simply abandon its vices and prejudices if presented with enough magical wish machines and space communism, rather than use those magical wish machines to manufacture weapons and drugs and rob banks and kidnap people with transporters.
Star Trek is just entertainment, and any attempt to read more deeply into it or extrapolate it into the real world, other than through whatever vaguely moralistic message the plot, itself, attempts to portray, is bound to be a waste of time.
ST certainly is Roddenberry's vision of utopia. But consider that people have endlessly attempted to create utopias on earth. Isn't that more interesting? The Pilgrims tried to create one. The Amish tried. The Mormons tried. The Soviets tried. The Nazis tried. Kellogg tried. Jim Jones tried.
What's different about ST is you can always make a fictional utopia work by just typing in "... and it works!" That makes it, to me, fundamentally uninteresting compared to real world attempts that are unable to adjust their scripts to reality.
Not from reading R+J, you won't, any more than you will learn about how utopias work by watching Star Trek.
If you want to learn about what people will actually do for love, read one of the many biographies of Henry VIII. (And there's always more to learn about him, if you're interested.)
Or you could read about Cleopatra & Antony.
I novel has a beginning, middle, and end. That's all there is to it. If you're a fan, there's nothing more. You can study it all you like, it's fruitless. You can see this with the Star Trek fans, all that interest and excitement pretty much goes nowhere. They wind up memorizing the scripts and doing cosplay.
With non-fiction, there's no beginning and no end. There is always more to the story. There are details omitted. There's a bias. It's like a fractal, the closer you get, the more detail there is. Thus if you find it interesting, you can satisfy that itch for more.
Caro's books are ones that satisfy the itchy person who wants to delve much deeper into a story than the usual insipid treatment. And if that isn't enough, Caro didn't include everything, there's always more for the next historian to unearth.