In any case, Kanji is so visual - until I learned it many words didn't make sense to me. Knowing how to say it, but not understanding the real-underlying meaning is not fun.
As far as intonation, Japanese is one of the easiest languages with regards to that. Once you get the basics it is simple, but still you must talk with others (Japanese club, co-workers, neighbors, skype, etc) and listen to real Japanese (anime, news, etc.)
This is very true. I grew up in an area where lots of Spanish is spoken, and I learned a tiny bit myself. For me, Japanese pronunciation was trivial. My teachers were praising me right off the bat. The only difficulty I have is with my current tutor, who is bent on teaching me to pronounce the Japanese r/l the way a Japanese would. (AFAIK it's not necessary at all for understandability, just a pet peeve of hers.) I had a very different experience with French and German, so I know I'm not especially gifted at phonetics. I think the early exposure to Spanish was the key.
Japanese people take for granted that Kanji is hard and are forgiving when Westerners aren't that great at it, but it's painfully hard to listen to someone speak with non-native intonation and poor grammar.