It's rare but you will still occasionally be denied services in restaurant regardless of how well you speak the language.

Or even if you speak to people in Japanese they will try to speak to you in English.