Why is "violence" your boundary? Most people agree that lots of things can be "bad" besides violence. There's a pretty broad consensus on that. You're going to need some pretty strong arguments to justify legalizing theft and fraud.

I'm not trying to justify legalizing theft and fraud - these are most generally justified by property rights, which are somewhat tangential here. Neither of them set a precedent for the government intervening in honest interactions between people. Lots of things are widely considered "bad", that doesn't mean it wouldn't be tyrannical to make them illegal.

You didn't answer. Why do you draw the line there? What's so special about violence that it deserves special attention from the state, while other bad things don't? I see you've also added property rights now, which are a totally separate category from violence. Why these things in particular?

Because violence is horrific in a way that nothing else is. Poverty and illness are facts of nature, no living thing is immune. What's special about violence is that it's perpetrated by other people, people who have the cognitive capacity to understand the suffering they are directly causing.

Violence is fundamentally preventable because people have agency in ways that animals do not. You'll note that only violence with knowledge is considered horrific. For instance, being attacked by a person with the mind of a 4 year old isn't considered nearly as bad as being attacked by an otherwise normal adult. The adult knew what they were doing and did it anyways.

> I see you've also added property rights now, which are a totally separate category from violence

I suppose it stems from the idea of natural rights - ie. what would you be able to do if there were no other people around? Would you be able to put something down and expect to find it where you put it? If so then you have "property rights": the reasonable expectation that your material activities will not be interfered with. The rest of it is mediating how your property rights interact with those of others.

Liberty is basically the idea that you should be able to do anything at all as long as it doesn't interfere with the rights of others to do the same. The legitimacy of government is derived from its defence of liberty. It's not about preventing "bad things".