> What are we as a collective supposed to do? Routinely exterminate criminals?

There are a zillion ways to reduce crime in a more friendly manner. I'm not an expert but what comes to mind are reducing the incentive to engage in criminal activity in the first place (economic factors could be at play), proper education, social projects, gun control, early psychopathological diagnosis, ...