News for hackers. Stuff that matters.
Re:Datomic: Look at all the things I'm not doing by BenoitP on Saturday April 21, 2018 @09:39AM (#16891379)
This will be a tongue in cheek comment, but there's another thing Datomic isn't making you do either:

GDPR compliance

Re:Datomic: Look at all the things I'm not doing by augustl on Saturday April 21, 2018 @09:55AM (#16891425)
OP here :)

True, in that there's no solution out of the box. I kind of want to make a "look at all the things I have to do", and GDPR compliance is one of those things where there are probably many ways to do it wrong with Datomic, and a few ways of doing it right.

One thing you can do, is to have a separate database for each person/user. It is trivial to join across multiple databases in Datomic, and you can even do crazy things like joining between a database and an excel spreadsheet. And deleting an entire database is easy. So there's that.

There's also excision, but that's a super expensive operation that you shouldn't be doing as part of your day to day routines, according to the Datomic team. I'd like to know more here. For example, is it OK to excise data once a week? Maybe it's GDPR compliant if deletion requests are batched like that.

There's also crypto shredding (encrypt values with separate key for each user, throw away the key on deletion request), but I'm not sure how GDPR compliant that is, since it leaves a lot of metadata behind. And you obviously can't encrypt values that you want to query on with the query engine.

Re:Datomic: Look at all the things I'm not doing by danielh on Saturday April 21, 2018 @12:39PM (#16892093)
IANAL, but I‘m pretty sure it is acceptable to delete data within 30 days of receiving a request to do so.
Re:Datomic: Look at all the things I'm not doing by augustl on Saturday April 21, 2018 @01:36PM (#16892342)
Forgot to add. The built-in excision API is similar to crypto shredding, in that all the metadata is retained, it's just the values themselves (in Datomic's EAVT structure) that are removed. So a lot of metadata is still retained.
Re:Datomic: Look at all the things I'm not doing by evanweaver on Saturday April 21, 2018 @10:55AM (#16891636)
For what it's worth, FaunaDB is also temporal and supports retention periods, TTL rows, and locality control, specifically for GDPR.

Document-relational model instead of Datalog.

Re:Datomic: Look at all the things I'm not doing by blunte on Saturday April 21, 2018 @01:12PM (#16892240)
Gpdr compliance is as much as not choosing to retrieve data after a certain point as it is not possessing that data.

It's a bit of an existential point, but if your logic allows the disclusion of data before a certain point of time, is that not effectively the same as not possessing it?

Re:Datomic: Look at all the things I'm not doing by davty on Saturday April 21, 2018 @09:42AM (#16891388)
Well, they do support extinctions?
Re:Datomic: Look at all the things I'm not doing by emidln on Saturday April 21, 2018 @01:38PM (#16892356)
Yes. They call this excision[0] and it leaves an Audi table hole in the timeline which lets you attach metadata like why there is missing data while still removing the data.

[0] https://docs.datomic.com/on-prem/excision.html

Re:Datomic: Look at all the things I'm not doing by blunte on Saturday April 21, 2018 @01:15PM (#16892254)
That is certainly something an add-on or external tool could provide.

Immutable is only immutable if you don't have write access to the lowest layer of storage.

Re:Datomic: Look at all the things I'm not doing by augustl on Saturday April 21, 2018 @02:19PM (#16892551)
It's difficult to implement this by hand, though. What you'll have in storage are encoded blobs of chunks of some kind of sorted set tree structure. So if you are to poke the data directly like that, I would assume it is much easier to just do an offline backup and a restore, and filter the data in the restore process somehow, which I believe is possible.