I understand the feeling, but I can usually adapt pretty quickly when someone speaks in a very unexpected accent. Sometimes I can even remember the sounds well enough that I can reinterpret it on the fly without having to ask them to repeat.