I've lived here for two years and my Japanese is still not great, though getting better all the time.

Both the highs and the lows have been bigger than I expected. I've loved the place on the whole but there have definitely been significant downsides too. If you don't like the culture I'd be very cautious about coming here.