News for hackers. Stuff that matters.
Re:An open letter to Netflix from the authors of the de-anon... by nkurz on Monday March 15, 2010 @04:18PM (#1193977)

  They have poor information sources for their prejudice
  now
Yes to that part. We should base our choices on our current situation, not an idealized view.

  I don't see what harm better information sources 
  driving their prejudice could do.
That loses too much nuance. I can see that it could do harm, but think that increased information could also reduce prejudice. In the particular case of movie reviews, I see the added risk as low, and the potential benefit as small but significant.

  The debate on privacy dangers is secondary, if Netflix
  refuses to release useful data in the future then that's 
  the primary danger
No, I mean secondary in the sense that we need to sort out the what the actual privacy dangers are before we try to come up with workarounds. If the outcome is that Netflix embeds some small print requiring all users to allow the release of 'suitably anonymized' rating data, has this changed anything? We still need to determine the actual risks. Perhaps the privacy advocates so right about the dangers that even an opt-in system should be prevented.

  I was working on a project with the data, and the FTC
  ruling appears to have put a stop to that.
People already using the data set internally will likely be unimpacted. The Netflix terms of release presumably still apply, and prevent most commercial usages. But research papers that need to cite a publicly available data set will be adversely impacted, and the legal 'cloud of fear' will likely prevent the release of future data sets.
Re:An open letter to Netflix from the authors of the de-anon... by madair on Monday March 15, 2010 @06:20PM (#1194300)
Thanks for responding. It helps, I was so tempted to argue with your points as I had misread them.

I feel strongly about the primacy of privacy because the problems of prejudice are so severe. But the transparent world approach has a lot of depth to it, and I'm nervous and excited to see where it leads us, since like it or not it the technical and social changes we're seeing are creating so much data.

Here are the issues I think we have with this particular data release. I understand they may be resolvable though, and while I argue against accepting privacy problems like this right now, I would definitely love to find out that we can shift to a more transparency society without reservation and without the level of abuse that I fear:

-- Information asymmetry, since most people don't typically keep the type of statistical skills, computing power, and even secondary data sets for cross joins and comparisons around. Information asymmetry is a widely recognized concern in social behavior and commercial law (i.e. insider trading & real estate contracts)

-- Ethical concerns seem to constrain us to taking people's own privacy expectations into account. Originally privacy loss didn't seem to be a problem, but the situation changed when evidence emerged to the contrary

-- History shows us that governments frequently overstep their bounds. Rather than argue recent events which are more clouded by emotion and the narrative of the day, I think most people would agree that the FBI in the 60s was quite abusive in their gathering and use of data

That said, transparent world all the way. How do we get there?