It's true. 50% may know a few words, but probably less than 5% speak good enough English to have a regular conversation about something more complex than the weather. You can definitely live in Tokyo without knowing Japanese and do everything you need to do, but your options, socially and otherwise, are always going to be limited.