A company outside finance might definitely have these problems!
In this case, it means that an append-only data store with a fixed retention time might be a perfectly reasonable way to store certain kinds of records. This means that an append-only data store is not guaranteed to run up against deletion requirements in all cases.
In my opinion, this is particularly salient and worth being aware of when the conversation centers around a financial company, data storage, GDPR, and deletion requirements. It is possibly not always likely to be as simple as "use append-only" or "append-only likely to be illegal".
Gee - how long until the GDPR-o-crats demand a fine from a company (possibly the "right to be forgotten" thing), and the company then uses the defense that "we would have destroyed the information, except for some other EU regulation.. You figure your own way out of that logical puzzle!"
Of course GDPR defenders tend to take a stance of, anything reasonable is actually not illegal under GDPR even if it might appear to be so at first. It really is a horribly vague and useless piece of law making. I really hope the UK scraps it after Brexit, though I don't hold out much hope.
An interesting question is would you rather your bank leaked some personal information about you, or would you rather they lost all your information, and therefore all of your money?