I think you will struggle to find numbers that support a high degree of illegal immigration from the US to the EU, and retaliation, justified or not, is the much simpler explanation. For unwanted but legal immigration, this has no impact.