There are many reasons why this might be out if your control, beyond visa requirements. Maybe you have dependents your can’t bring with you (sick or elderly family for example), or maybe your SO has a job that’s hard to move. Or you have a family and can’t afford the crazy SV rent for a place large enough.
It is false that the US is the ideal place to live in (or to temporarily migrate to if you're in tech). It is false that, all other things being equal, one should prefer to live in the US. The US is not the default place people should aspire to live in, not even people in tech. Even within the US, SV is not the best place to live in. Living in some place means much more than just working in trendy tech companies.
For a lot of us -- I'd say the vast majority, outside the HN bubble -- the US is not a particularly interesting place to live in, even if there were no immigration barriers. Which there are, anyway.
Money, and opportunity for their children to earn money, is the reason so many people have immigrated to the U.S in the past century.
Money isn't everything, but you can sure buy a lot of freedom with it. Of course, nothing in life is risk-free, and making money is no exception, and the U.S. is unforgiving when it comes to those who come here and fail.
Being American is a pretty great gig, for all the stuff you keep hearing on the news. There's a reason silicon valley is silicon valley, New York is New York, and so on. Theres a lot of luck that comes from being here. My parents left behind their entire support network in india to set out on their own, navigated the complex immigration process (granted, easier 20-30 years ago than now), and made those sacrifices, and it more than paid off. And I got lucky by just getting to be born here. Things like "you dont want to move outside your country " are completely valid, and part of why american immigration works is because immigration is such a hard thing for people to do (leaving everything behind) that it self selects for the people willing to make those sacrifices.
The one valid one you mention is the difficulty of immigrating. That can be a straight up barrier in the way of a motivated person that would be a useful addition to this country and should be removed. This is the country of immigrants. We should keep that part of our culture alive.