Sure, but the large majority of the population lives in those handful of big cities. 1/3 of the population lives in the greater Tokyo area alone. Ignoring the people who live in American-style suburban sprawl means you're ignoring a small fraction of the population. This is basically the reverse of the US, where a small fraction lives in walkable city areas like Manhattan, and everyone else needs a car.