Matthew 5:38 — He advises his followers not to retaliate when attacked. He does not tell them to go out and disarm anyone else, or petition the Roman government to hypocritically do so on their behalf.
Mark 12:17 — When the Pharisees attempted to entrap Him with a question when could not be answered either "yes" or "no" without enraging either the Romans or the religious leaders, He evades the original question and turns it into an admonition to give people (and God) what they are due. Note that he never actual said that the coin was owed to Caesar, though many people seem to assume so. He only asked whose face was on the coin. The idea that not just the tax being demanded but all coins actually belonged to Caesar just because his face was stamped on them would rightly have been considered ludicrous. And no matter how you take that conversation, the fact remains that he never made any comment on the merit of the taxes themselves. There aren't any statements in support of the practice of taxation, and all the points about providing for others, supporting the poor, etc. involve personal contributions, not political action.
On tax, Jesus was giving that response to an entraping question from Pharisees they asked because He had in past criticised of harsh tax policy. Force tithing is not a thing of New Testament but old.
Their crime and imprisonment rates are far below those of the US. Even on an individual level, the presence of non-religious individuals is assocated with a series of positive societal effects: https://www.researchgate.net/publication/227616923_Atheism_S...
Religion isn't necessary for public morality, and as America has shown, is often actively harmful. America is full of people who assume that they are good people BECAUSE they go to church rather than because of their acts. By and large, these are generally not good people. Instead, they're among the most judgmental and least helpful members of society.
To paraphrase Gandhi, "I like your Christ, not your Christians". The religious in modern society can't even be bothered to read the Cliff Notes of their own book, otherwise they'd be focused on helping the poor and remembering that rich people have trouble getting to heaven rather than going around promoting guns, no taxes, and slashing social safety nets.