If I never buy a product from Apple or Exxon, there's no problem with that. If I don't pay taxes I go to jail.
Actually you would expect taxpayers to be even more vociferous in pushing audit requirements on government departments than shareholders are in ensuring their portfolio companies are correctly audited.
And if you discover that a company is not doing enough to prevent fraud then you can divest yourself of that company. This in itself is another form of negative feedback which exists much more strongly for corporations than for government. Because individuals divesting themselves of a public stock company will result in the stock price dropping which will have a negative impact on the company, encouraging it to do something about the problem.
And as pointed out in another reply a huge difference between companies and most governments is that countries tend to get the vast majority of their funds from taxes while companies hopefully should get their money from customers. But there are exceptions to this rule, some countries do not have any taxes.
Governments spend YOUR money, companies spend their own money.
On top of that, companies are subject to competition and, as cynwoody pointed out, they can go out of business. This means that the incentives for reducing fraud are greater in private business and companies that have high levels of fraud that are easily reigned in by obvious solutions will be at a huge competitive disadvantage and more likely to simply go away.