Ask HN: Are Lucene/Solr/ES Still Used for Search?

Re:Ask HN: Are Lucene/Solr/ES Still Used for Search? by balfirevic on Friday July 19, 2019 @11:45AM (#20479577)

> Agreed re: using ES as primary storage (which it is NOT meant as) - as far as I can tell, it might even make you in breach of the GDPR [0].

How is GDPR compliance of having data in Elastic Search influenced by it being primary vs. secondary storage?

[ Parent | on HN ]

Re:Ask HN: Are Lucene/Solr/ES Still Used for Search? by rickmode on Friday July 19, 2019 @12:27PM (#20480016)

See my reply to bryanrasmussen for a full explanation.

Basically: you reindex ES periodically, so when a user is deleted from the primary, it will disappear from ES upon the next reindex. The old index is deleted at the file system level.

[ Parent | on HN ]

Re:Ask HN: Are Lucene/Solr/ES Still Used for Search? by ipython on Friday July 19, 2019 @12:39PM (#20480152)

At some point, though, the pedantry can get out of hand. After all, 'deleting' at the file system level is just 'unlinking' the inode from the underlying data blocks... in fact, data forensics at the file system level is probably more well-understood than recovering deleted data from a Lucene shard.

at what point would you be able to 'delete' data without being in violation of GDPR?

[ Parent | on HN ]

Re:Ask HN: Are Lucene/Solr/ES Still Used for Search? by eivarv on Friday July 19, 2019 @01:56PM (#20480941)

I know - it really is a matter of definition.

Though the EU has said it will consider intention etc. there's really no way of knowing for certain until when and if it's settled in a court case.

[ Parent | on HN ]