“If enough of them came, they might vote for an Islamist government...”

Given the rate of expansion of islam, i would say when not if.