For aggregate totals of your VAT liability across your total set of invoices, you'd be fine with rounding up to the nearest pound, to the Inland Revenue's benefit. For individual invoices however, you were required to stick to very specific rounding rules.
On personal tax forms you have to round in the taxpayer favour. If your income is 12345.67 you round it to 12345. If your expense (say giftaid) is 12345.67 you round it to 12346.
Surprised it's the other way with VAT, but then I do very little with tax other than click a few buttons and confirm "yes, you have to tax me as I have children".
The key, though, is that with taxes, if at all unsure you've got the rules right, the safest option is to round in the tax offices favour.
It's in general a lot less painful to explain an overpayment than underpayment if something is broken.
Of course, better yet, get it right.
I bet they care about you not throwing away decimals in intermediate calculations for VAT or sales tax.
What is your jurisdiction? In Canada, I can't for the life of me imagine the CRA would remotely care about decimal-point accuracy. In fact, most of their online forms explicitly remove the decimals.