Yes, they avoid paying some French corporate taxes. The French have been fully aware of this for decades. Even if they somehow missed everything else, the Lisbon Treaty was rejected by the Irish until they got assurances from the EU that it won't affect taxation. Part of the reason the EU exists in the form it does is due to this taxation.