Indeed, but 'the EU' isn't the one enforcing it or leveraging fines - it's up to national bodies/governments and law enforcement.

From that link we can see that the UK fined its own Ministry of Defence 400,000 EUR.

However it appears that Finish public bodies are deemed above reproach by their government.