I just spent $10,000 editing and producing my latest book that's going to be self-published. Comparing the royalties I'll get with self-publish (not using CreateSpace BTW, though I have no problem with them) including those fees - not even half of which would be picked up by a publisher, mind you - with a publisher who absorbs ALL of my editing/producing costs is STILL a joke. Publishers are predatory towards anyone but the somewhat-ready-to-breakout writers. They do nothing for the established writer except salve his ego and they do nothing for the startup writer who begs for help.
And more important, to many new and more established writers, the editors in publishing houses provide serious value in the form of advice and guidance. It's easy to think that because you read books you surely know how to write a good one. But that's similar to thinking that because you use applications you surely know how to code a good one.
And lastly, good publishing houses serve as brands for consumers. People won't see a self-published technology book with the same eyes as if it was published by O'Reilly (for example). From past experiences they probably feel guaranteed of a certain level of quality from the O'Reilly book that a small lone author almost never can provide
I'm not claiming that the publishing system is a panacea or that all editors are amazing. But you described it as mostly useless, bordering on a ripoff, and I think it's far from the truth.
Of what? The cost of the books? Because advances have gone basically to zero. I was offered none.
As far as your other questions: Books won't sell unless you curate an audience prior to writing it. And if you do that, the need for a publisher disappears quickly.
I don't know with which publishing houses you've been in contact with, and I think most of what you say comes from a bad experience with dubious publishers. But, in a serious one you work with an editor, whose job is to read your manuscript and tell you what's good and what can be improved, and how it can be improved. A good editor with some knowledge of the field your book is about is an enormous help.
James Altucher has written about this extensively, and his stuff is very widely read (certainly far more than I).
Most of the publishers I've spoken with are well-regarded non-fiction houses who have done medium and big time projects. Their cut of royalties were usurious, to say the least. When I compared what I got with what I would be paying them, it was insane. That's where my perspective comes from.
...
Have you noticed that most PUBLISHED stuff is garbage, too?
Worse, the argument is over pricing on e-books, not physical stock, so Hachette's stance makes even less sense.
As usual, Paul Krugman sees everything through a political lens, so naturally Amazon is evil and must be beaten down.
If the lower price really would make more money for everyone, then surely Hachette would readily do it. Since they don't, and since they understand this market as well as anyone, a reasonable person might assume that they would indeed make less money with a lower price.
Even free-market fundamentalists must see that free markets don't function when dominated by monopoly or monopsony. So isn't there a legitimate public policy question about whether the state should limit that market power?
Lower prices decrease profits for book publishers who make money both from Amazon and book stores.
In the case of books, you'd see that by cuts in editing, by authors shortening the amount of time that they spend writing a book, and through authors dropping out and leaving the field to less talented writers with fewer alternative income sources.
The textbook monopsony is government health care. Most visibly, the long wait times for some health care services.