It's interesting that you feel that way. I've taken two foreign languages at the university level, and they were both taught in an "immersion" style manner (that is to say, all the instruction was in the native language) and have found it beneficial rather than harmful. But perhaps I reach for a dictionary more often than you did.