It was expected that racists would vote for brexit loudly anyway. The problem is why everyone else, and especially what you would consider moderate people voted against EU (which is not really a vote against immigration; and it will barely stop it)