I get the impression (and I could be woefully wrong) that the IRS, kind of like the USPS, has an awful reputation that was justified some decades ago, has turned it around because of that awful reputation, but inertia means the reputation persists long after the underlying reasons have been remedied.
From what you describe, they sound much like HMRC.
And yes, withholding payroll tax (or VAT) and not passing it on to the government is pretty crappy. HMRC is typically understanding if this is a few months or even a year down the line and they think the business will be able to pay up - they frequently agree payment plans for such things - but three years without noticing kinda takes the piss.