The economic problem Japan faces is temporary while the demographic change from immigration would be permanent. It makes sense that the Japanese are avoiding it.