Actually I recall an Asian math teacher who used basic English but did so to great effect. Her way of breaking problems down really helped me grasp them more effectively. Of course other non-native instructors were not as good, so I'd guess it depends.