See how our emotions get in the way when parsing the above?

That's one of the fundamental issues with the entire topic - emotions ranked are above evidence based policy.

Strangely enough poor uneducated immigrants are easily net positive for society, and so are educated ones.

I recommend reading "The Economic Consequences of Immigration" for a good picture of the benefits and costs.