And then those people would repatriate funds, raising the quality of life in poorer countries and reducing the need to emigrate.

Labour is a tradable good, and as such the labour market must be an open as for any other goods (or services).