My point is that in factory jobs, the end result is usually just to get the job done, whatever that may be (building parts of a car, etc). As long as the workers can understand you and you can communicate what needs to be done, it can work.

White collar jobs usually involve more meetings, knowledge of business culture and language. This is much more difficult to outsource to countries that don't share any of the same culture and language.

This is also why outsourcing development jobs has been mostly a disaster for US companies.