News for hackers. Stuff that matters.
Re:Event Sourcing Is Hard (2019) by justusw on Tuesday November 30, 2021 @06:24AM (#29391003)
Is Event Sourcing compatible with GDPR?
Re:Event Sourcing Is Hard (2019) by ddek on Tuesday November 30, 2021 @06:38AM (#29391068)
The issue with GDPR is right to erasure, which is tricky in conventional systems. But in ES systems, naively implemented, it is not possible. If you are writing PII in plain text, an immutable log won't let you remove it. OTOH I have two options: store PII in a separate database, and just delete or nullify when requested; or use per-user encryption, and delete the key.
Re:Event Sourcing Is Hard (2019) by EdwardDiego on Tuesday November 30, 2021 @06:55AM (#29391191)
Yeah, for GDPR compliance when you're using Kafka, the key is to use, well keys, and log compaction.

Then you can retrieve PII for a GDPR if needed.

Or, remove it entirely by submitting a "tombstone" record with key -> null, then log compaction removes it.

Which basically means, don't mix PII into transnational data.

Re:Event Sourcing Is Hard (2019) by lucian1900 on Tuesday November 30, 2021 @07:01AM (#29391225)
The GDPR concept is "personal data", partly since it doesn't just refer to ways to identify a person.

PII is a similar but different US concept.

Re:Event Sourcing Is Hard (2019) by dairyleia on Tuesday November 30, 2021 @07:37AM (#29391455)
An Event-sourced system can be compliant with GDPR, with crypto shredding: https://www.eventstore.com/blog/protecting-sensitive-data-in...