Because ALL of the jobs are in Tokyo (or Osaka, or Fukuoka). Note that Chiba city is growing faster than Tokyo and it's a suburb (same with Tsukuba)! Shin-Yokohama is getting too expensive.
It's not just housing. Look at bare land or abandoned buildings in CA. Those also grew by similar amounts or even more! Why develop it when it goes up in value? Why not own multiple empty homes when they "only" go up in price. Well, welcome to higher interest rates and likely a less deflationary world (deglobalization) with non-wage inflation that prevents the Fed put.
Everything you point out isn’t driven by interest rates but instead by artificial supply constraints on housing.
https://tradingeconomics.com/japan/interest-rate
No housing is not a financial asset in Japan.
However, China where they have built massive quantities of housing, it is an exceptionally expensive financialized asset, because that is where lending went.
It's not going to be a US-style giant house with a green lawn, but it isn't some dystopian hole in the wall or giant share-house like non-wealthy San Francisco residents are stuck in.
You can fire up Netflix and watch some of "The Full-Time Wife Escapist" on there to see a normal small apartment in action. It's tiny by US standards, but people can live there comfortably.