But we don't make people ignore Latin alphabet when switching from English to German, Spanish, etc.

Why would this predisposition of seeing alphabet as connected to own sounds be worse with languages that don't use it natively?

If anything, English speakers have it easy - most English language has very loose connection between letters and sounds, i.e. most letters can be pronounced in wildly different ways depending on word or context. As such, English speakers should be used to constantly re-interpreting what a letter sequence sounds like - unlike those of us with phonetic language background, who are frankly constantly irked by English in this way ;)