I never have any problems expressing myself in a work-setting, but as soon as we start talking about every-day things it's more of a challenge. Knowing the name of different kinds of food, house-hold items, literature... you immediately notice a language barrier that is not there when we use the "programmer lingua franca".
I realize that the days of requiring Latin as part of a medical education are behind us (though not that far behind us), but Latin's footprints are all over the practice of medicine. I think the reason this isn't more obvious is that, in medicine, "Latin" is mostly interchangeable with "jargon" or "terminology" -- it's just "something you learn".
Someone else asked about a programming language like Ruby, which was developed in Japan and whose early users were all Japanese, why does it still use "def", "if", "for", etc. As an English speaker one is tempted to ask, "Why do the Japanese use English", but I would wager that the Japanese would respond, "What English? This is just programming terminology."
So it is as important for programmers to understand English as it is for doctors to understand Latin. Of course, most doctors may understand Latin, but they wouldn't be able to converse in Latin. In that sense, English is also the programmer's lingua franca.
That term -- lingua franca -- is an interesting one. In addition to being used as a colloquialism for "a common language" it was also, itself, a language: http://en.wikipedia.org/wiki/Mediterranean_Lingua_Franca . Just as Lingua Franca eventually took on a life (and grammar and vocabulary) of its own, I expect "hacker English" will, over time, do the same. In fact already my (English-speaking) wife thinks that I'm speaking a foreign language half the time when I'm talking with colleagues over Skype.
It's less important to know "English", and much more important to speak, converse, and communicate with other hackers using the lingua franca of the day.