Virtually every rural area in Japan has expat English teachers. In my immediate area there are probably 10 or 20 people who are native English speakers. I think that's typical. I tend hang out with Japanese people since I speak Japanese and my wife is Japanese, but it's not terribly difficult to get by without much Japanese language skill, especially if you are young.