In order to successfully complete college, one needs an IQ of 110 which is of course above average of 100. Others are being left out not because they don't work hard, but because of biology/opportunity.
If one reads Harford's book, which I found out from the Freakonomics people, they'll get a better idea that the intent is that low educated immigrants compete with low educated American citizens for jobs and drive down wages and that highly educated immigrants (think H1-B visas) compete with highly educated American citizens.
The problem is not immigration, but the percentage of the population should have remained at 5% of the population and not at nearly 14% (which does not include 11 million immigrants here illegally).
By comparison, in 1990 about 1 million of 60 million Brits (1.5%) and now it is 3.3 million or about 5%. The legal immigrant levels in the US today are 3 times that of the level the Brits voted for BrExit.
In any case, the specific stats Harford cites are cross sectional. This means the averages include immigrants and fall victim to the exact same Simpson's Paradox issue that I discuss above. To show that immigrants have reduced anyone's wages, you need longitudinal data.
And your question is also malformed, because you don't specify whether you are discussing the children (who may be educated) of uneducated American parents, or the uneducated children of American parents (who may or may not have been uneducated).