News for hackers. Stuff that matters.
Re:Ask HN: What medical datasets do you need? by swalsh on Wednesday April 05, 2017 @01:10AM (#14039827)
So the naive method is to just remove any information such as name or birth date. However the medical data is still identifiable. So we need to alter that too. However, we did analytics, so altering it might ruin the results. So we needed to design ways to scramble the data so that it wasn't identifiable, but that in aggregate the results stayed the same.
Re:Ask HN: What medical datasets do you need? by wackspurt on Wednesday April 05, 2017 @01:33AM (#14039922)
Did you use something like Differential Privacy?
Re:Ask HN: What medical datasets do you need? by telchar on Wednesday April 05, 2017 @10:42AM (#14042401)
I would be very interested to know if anyone is using that in practice. It seems like a promising concept.
Re:Ask HN: What medical datasets do you need? by wackspurt on Thursday April 06, 2017 @04:31PM (#14054301)
Apparently, DP has some detractors. I was told by my signal processing professor that differential privacy wasn't really a solution for privacy preserving data analysis. He said something along these lines: "if I know something about the underlying data distribution (Gaussian, etc.), it is possible to wash out the randomness."

Now, I don't understand DP well enough and information theory/signal processing still seems a bit like "dragons be here" to me. But, I want to take a stab at trying to reason why he said that.

For example, take randomized response (the only DP technique I understand). That is vulnerable to a longitudinal attack: a person can query repeatedly to wash out the randomness. If you think about it, isn't it the almost the inverse of a repetition code (error correction)? There, you're trying to use redundancy (repetition) to remove noise.

Re:Ask HN: What medical datasets do you need? by telchar on Tuesday April 18, 2017 @01:47PM (#14141074)
You're right that with repeated sampling you can learn more about the data set. If I understand it correctly, I think the solution to that in DP is that you have a limit to how many times you can make your repeated query before you have spent your privacy budget and are cut off. The idea is that for a given budget level you are limited to fewer queries than you would need to learn enough to de-anonymize the data set.

If your signal processing professor was already taking that into account then I would be curious to know how that attack would work.