You need to carry a passport if you're a tourist in Japan. Although I did forget once and nobody cared, it isn't guaranteed.