I'm half-deaf with a cochlear implant; context switching is incredibly difficult! I've had similar problems where I assume someone is speaking either Japanese or English and "filter" accordingly.