No one's saying authors shouldn't care about the appearance of their book, they're saying it should be decoupled from the production of the manuscript. You can productively worry about the appearance after you get the "nice list of words, with chapters" aspect of the manuscript down; that's the logical structure, and, obviously, the hard part. The point is that you don't need a perfect WYSIWYG editor for the manuscript.