That view is ahistorical. Anti-immigrant sentiment has always been directed at the source of the immigration. When Chinese began immigrating in the mid-late 19th century, immigration was suddenly a problem and so we had the national origins formula which ruled until 1965.