Regulations assume the individual will take no responsibility. Admittedly, as I said above, there are people who do not do so. But if the judges threw the book at the people who did so, so that it cost more than just making restitution... maybe people would change.
Rather than just regulating ourselves into a straightjacket made of permits, I'd like (even a little) more responsibility over my mistakes and less permits to file/pay for.
What you call restitution is known in law as economic damages. When you mention throwing the book at people who try to evade their responsibilities, that's called punitive damages. The tort reform movement is always saying that damages are abusive and that people should be protected from punitive damages, and tend to be opposed to excessive regulation as well. The plaintiff bar argues that without the threat of unlimited liability injured parties will have no legal remedy.
Consider the alternative, where your neighbor turns out to be an obnoxious ass and brings suit against you without a good reason. It happens, and if your neighbor is wealthy or just very persistent then fighting off his suit will be an expensive inconvenience at best. By obtaining and complying with a permit, you are insulated from his abusive litigation.
This does not happen so often with homeowners, but such conflicts between businesses are not at all uncommon - think patent litigation. http://en.wikipedia.org/wiki/Sturges_v_Bridgman is a famous example; in a nutshell, your private rights are subordinate to society's overall interest, since the latter is nothing more than the aggregated interests of other private individuals. The object of fees and permits is not to maximize revenue but to minimize litigation, which usually ends up costing more than bureaucracy.
None of that in any way justifies the need for inane government regulations that do nothing but inhibit your freedom because of hypothetical scenarios.
You realize that these regulations are usually put in place as the result of litigation, yes? You know, dreadful injury happens, litigation ensues, party at fault demurs, plaintiffs campaign for better regulation to prevent similar injuries to others. All other things being equal, the cost of regulation or litigation ends up being the same, but it's a lot more predictable if you cover that cost up front.