>they most likely wouldn't be able to differentiate the two sounds consistently without having had training

I learn English since I was pretty young, I believe I'm quite fluent (I mostly use English for work, I lived for two years in an English speaking country, I read books in English, etc), and I still have problems distinguishing some English vowels. I think sound acquisition is one of the hardest things to learn for a non-native speaker.