I think most people will admit that learning to write Japanese well is something not many foreigners will ever do, while speaking isn't that terribly difficult. I spent a little bit learning Japanese and I found that learning speaking + romaji only at first was not only easier, but helped when looking at symbols later (since I already knew how the words were said).