Re:Database Lab – Full-size staging databases as a service
by penagwin on Friday February 07, 2020 @03:29PM
(#22270554)
> There are masking tools out there that can mask data from production
Thank you so much! "Masking" was the phrase I needed to find some potential solutions! I wasn't able to find much before, that points me in the correct direction. Thanks!
Re:Database Lab – Full-size staging databases as a service
by samokhvalov on Friday February 07, 2020 @05:02PM
(#22271512)
There are various approaches here, and there are some FOSS tools that you can use.
Some links:
- https://blog.taadeem.net/english/2019/01/03/8_anonymization_... – description of methods, and a tool for Postgres, postgresql_anonymizer
- https://habr.com/en/company/yandex/blog/485096/ – not for Postgres, it's for ClickHouse (open-source DBMS for analytics) but covers the topic very well.
There are masking tools out there that can mask data from production in-flight before dropping it into a dev environment for testing (so you can get the same data with the sensitive parts changed), but this doesn't appear to be one of them. I know people who work in the field, it's a tough nut to crack to keep the database good enough to test with while making sure you don't have devs running around with customer data on their laptop/server.