Is it possible? Yes. But that doesn't make it a "fifth column". The country is not the majority, it's everyone. Maybe start dealing with it by looking at why the minority is hostile, and creating a country where they feel included rather than excluded.