Re:Show HN: Neosync – Open-Source Data Anonymization for Pos...
by edrenova on Wednesday May 22, 2024 @07:24PM
(#40448138)
Nice! appreciate you sharing it - would love to see the code at some point but looks like it's confidential.
I spent a lot of time building tokenization solutions at a previous startup so we'll definitely support tokenization at some point. There is a good use-case for it as well!
Re:Show HN: Neosync – Open-Source Data Anonymization for Pos...
by 3abiton on Wednesday May 22, 2024 @06:50PM
(#40447738)
Nice article, but a bit different than the OP authors who published a fully fledged open-source tool, is your code also available open-source for the community?
Re:Show HN: Neosync – Open-Source Data Anonymization for Pos...
by kjuulh on Wednesday May 22, 2024 @06:53PM
(#40447769)
Sadly not, it is very much tied to our workflows and as such wouldnt provide much value for anyone else other than a reference. Nevertheless I thought I'd share our approach to anonymization / pseudoanomyzation as I haven't really seen that done elsewhere.
We'd built a tool which can traverse data extract the pii data and put back a token into the data. Before one of our allowed systems would read the data we'd swap in the actual data or an anonymized version if we didn't permission to use it anymore. So we sort of get the best of both worlds we can use the actual data of our customers because we require it, but can safely use data for analytics and retain a lot of the statistical variance of our data.
Crazy complex project to work on given our limited resources but very fulfilling in the end.
It should be mentioned that I don't mention the difference between anonymization and pseudo anonymization in the article mostly because I didn't know it was really a thing. I just implemented a solution given or requirements
https://tech.lunar.app/blog/data-anonymization-at-scale