Right, they should be beholden to the letter when it benefits them and the spirit when it benefits them. Seriously -- you wouldn't want to live in a world where this isn't the case.
* Nobody should have a technicality in the letter result in fines and punishment when they were following the spirit in earnest.
* Similarly, nobody who takes care to follow the letter exactly should be punished even if it violates the spirit. Because otherwise people and companies have no clear way to know what is and isn't allowed.
It's only when someone is violating both the letter and the spirit that there are grounds for punishment.
I'd argue corporations specifically could do with some more fear of the stick, in the cases where they fall in a grey area.
I think that the letter of the law must be applied generously and sparingly - but the rapid expansion of egregious evasion should be addressed because it is having corrosive social effects that will compromise this attitude and the norms that underpin it.
Also having other things in play doesn't mean that this thing shouldn't be fixed...
A full tax case can easily run for 5 to 10 years, and the upside will be relatively limited. A lot has already been done in recent years and for a lot of EU companies the actual tax rate they pay has gone up with a few percentage points. But now most of the low hanging fruit is gone.
The notion that these companies should only be beholden to the strictest letter of the law is nonsensical.