It’s not only that. It’s just more work communicating with someone in your non-native language. Especially in Japan where many people don’t speak English well. So you’re creating an additional burden on the people around you.

And that absolutely should be shamed, especially when you’re talking about a society like Japan that places high value on individuals acting in ways that make things easier for people around them and society at large.