Living in Tokyo is amazing, but working for a Japanese company as a dev is probably not a great career move if you're relatively young. Software Engineering in Japan is many years behind the rest of the world, the pay is relatively low, and it isn't considered as desirable of a career as it is in other countries. It would be much better if you could find an international or remote company that allows you to live in Japan. Then you can get the best of both worlds. If you don't speak Japanese you probably wouldn't be able to get a job at a Japanese company anyway.

> However certain things like culture the language, and making new friends has held me back

I think it's really hard to generalize because it's different from person to person. However, I think it's a very different experience if you speak Japanese. Roughly 95%+ (if not more) of the population in Tokyo does not speak English more than a few words. You can certainly get everything done in English, make contracts, find housing, find friends, there is a big enough community, but your social life will be extremely limited if you don't speak Japanese.