At this point it's not really a lot more expensive especially when factories are so heavily automated.

The US has had semiconductor fabs for many years that are still operating. It just so happens that TSMC has the best process, but I don't think that has anything to do with labor costs.