> I hear "I'm not anti immigrant, I'm anti illegal immigrant" a lot. To which there is an easy solution: increase the number of legal immigrants we allow.

Being "anti illegal immigrant" doesn't have to imply you let in whoever wants as long as they follow some process. You are taking away the agency of the people to select its immigrants.