I believe the difficulty you refer to is caused by the inadequacy of the script to address Chines vernaculars, like Cantonese. Written Cantonese has many characters that would be alien to a monolingual Mandarin speaker.