How much money does that total (the taxes specifically earmarked for funding regulatory bodies)?

If a company suddenly starts doing something that costs society more in externalities, does it suddenly start paying more taxes to deal with the enforcement required to get them to stop?

After all, the whole point of regulation is to get the regulated to stop hurting society and costing it money.

Regulations aren't all designed for society's well being. Some regulations are very narrow and help only specific businesses, like tarrifs.

Regulations aren't all designed to help specific businesses. Some regulations are designed for society's well-being.

Then society should gladly finance their entire cost.

The cost addressed by regulation is the cost on society of the unregulated behavior.

An alternative might be, no regulation, but businesses are responsible for the costs of business to society (pollution, poor mental health, potential that it's a scam). After all, businesses benefit from these things, so they should gladly cover their cost to society.

Personally, I prefer less pollution.

Some regulations are designed to satisfy ideological whims of the legislature, and they don't benefit society at all.

No they don’t. Every dollar the government spends is a brand new dollar. You can’t save up money in a currency that you issue.

As a fiat currency issuer, you have two options, you can create money for circulation (government spending) or you can destroy money and it’ll never circulate again (taxation).