I had a run in with the labor department at my first company. I wouldn't exactly call them jerks (or nice) but I was able to get them to cut in half a 5 figure amount they assessed me (a lawsuit was filed) by having a personal meeting with the local office head. Without an attorney. After I cut the deal I then said "oh one more thing can I have 5 years to pay this back?". And he agreed (I didn't need the 5 years, it wasn't a large amount, but I thought why not?)
From what you describe, they sound much like HMRC.
And yes, withholding payroll tax (or VAT) and not passing it on to the government is pretty crappy. HMRC is typically understanding if this is a few months or even a year down the line and they think the business will be able to pay up - they frequently agree payment plans for such things - but three years without noticing kinda takes the piss.
I say this as someone who once had a pretty decent unexpected 5-figure liability that I had to work out with them.
I also don't feel like zealous enforcement of unremitted payroll tax is particularly abusive, since that's essentially describing companies stealing from their employees.