I do agree that people who use this approach are behind others in reading / writing performance. Indeed, it took me awhile to catch up. But fortunately this is something you can pick up on your own fairly well.
On the flip side, to be brutally honest, 99% of the people (that I've met anyway) who come through programs that focus on reading / writing sound horrible when they speak. They tend to suck at grammar, their intonation is all wrong and have a very hard time creating complex sentences. It could just be the sampling that I've interacted with but I can always tell the difference immediately between a JSL student and someone who focused on reading / writing.
Why is this important? It depends on your job / life but I personally spend my most important moments interacting with people via speech, not text. I'd much rather create a strong impression in person up front. It makes all the difference.
That said, there are vanishingly few times in life when an engineer is required to handwrite anything other than their name and address, but I have to speak to people constantly. When I do, I'm consistently reminded how fortunate I am that I learned contextually appropriate Japanese, a strong foundation in grammar, and proper polite Japanese (something many American Japanese programs just abandon on the excuse "bah, that's hard and you don't really need it" -- which sounds great until we're being introduced to the mayor and you say "Yo gramps where's the crapper?").
That is not an exaggeration, by the way. I spent the next hour apologizing for her. (For students of the language: ジジ、トイレはどこ? vs. standard Japanese トイレはどこですか? vs. in consideration of the fact that the mayor vastly outranks both of us すみませんが、お手洗いはどちらにあるかご存知ですか?)
I share your not-too-bright-6th-grader feelings during the 1% of the time I actually have to write something with my hands. ;-)
I studied Japanese for many years and always had the Kanji wall. It was daunting and hindered my progress. In the end, it made Japanese seem mysterious and not really possible for western-minds to grasp.
I used RTK and got through Kanji in four months, now I focus on sentences and reading wherein I speak out loud while reading. I also speak with my family in Japanese as much as possible (this is my primary reason for studying).
In the end, you must treat the language as a living language and understand all forms it is presented in. But, you already get this point, just saying it for others. :)