That's literally how the Nazis happened though? We know what happens if Nazis are tolerated: they grow in numbers, seize the government, and commit the holocaust. We know this because it already happened once.