There is a very strange attraction between Japanese and French. A lot of people in both countries magnify each other culture. I think it is partly due to projection but also to a long history of collaboration and exchanges.
It is ridiculously easy to be a French in Japan. A lot of people immediately become very friendly to me when they learn where I am from.
Also, there's one thing I'll concede to Japanese culture: they do take food seriously here! That's also a strong shared point.
My parents lived in France for a while and still revere parts of French culture, so I'm familiar with it. Honestly I can't imagine having to reconcile that with Japanese culture. I'm often surprised, though, because French people in general seem to do well in Japan -- especially compared to Americans or British people. Anyway, I feel for your situation. It can't be easy. I hope you find a path that works out for you!