You are correct to point out that moving large scale physical manufacturing is a massive undertaking. Building a factory in a new location is the least of your worries; available skilled workers, supply chains, transportation networks, various legal hurdles all have to be overcome. But it's doable - after all, it has happened in China's direction over the past fifty years. What you said was true of the United States once (and still is, in many industries).