News for hackers. Stuff that matters.
Re:What has happened down here is the winds have changed by s_q_b on Saturday October 15, 2016 @11:36AM (#12714329)
Good scientists should welcome this challenge with open arms, sunlight all of their data and code in a repository, and show how proper statistically rigorous research is conducted. That's an elevator right to the top of the field.

If I wrote code that messed up, I'd patch it. If someone else points out a bug? Even better, now I don't have to find it myself. But I would definitely not feel attacked or nor would I blame the QA engineer. It's my mistake, and so I must own it. These researchers need to do the same.

I believe full publication of code and data should be required for peer-reviewed research. If I can't look at your raw data or your algorithm, it is simply not possible to determine whether the study is correct. The social sciences must adapt to more statistically rigorous methods.

After all, the only two choices are adaptation or extinction.

Re:What has happened down here is the winds have changed by Someone on Saturday October 15, 2016 @01:06PM (#12714719)
"sunlight all of their data and code in a repository"

Good idea where possible, but "all their data" will be problematic in many social science studies, and also in medicine, because of privacy laws.

Re:What has happened down here is the winds have changed by semi-extrinsic on Saturday October 15, 2016 @03:28PM (#12715322)
Also, in many cases in the physical sciences, the data sets (both from experiments and simulations) may simply be too big for long term storage, let alone sharing. CERN is pushing the envelope at around 1 TB new shared data per day, but projects run by groups as small as five people can easily generate tens of terabytes in a day. E.g. with turbulence simulations or tomographic PIV or even just multiple high-speed cameras.
Re:What has happened down here is the winds have changed by s_q_b on Saturday October 15, 2016 @05:33PM (#12715737)
Conservatively, it's about $7.00 per terabyte to store and retrieve data on Amazon Glacier per month. Working with petabyte size streams and storage is a pain, but it can be done.

https://aws.amazon.com/glacier/pricing/

Re:What has happened down here is the winds have changed by wyager on Saturday October 15, 2016 @01:17PM (#12714758)
Anonymize the data then, if plausible. We ought not to trust studies that are inherently irreproducible.
Re:What has happened down here is the winds have changed by Someone on Saturday October 15, 2016 @01:19PM (#12714766)
It's practically impossible to anonymize data without throwing away the information contained in it, doubly so if you don't know at the time what questions critics will want to see answered on that data.
Re:What has happened down here is the winds have changed by wgyn on Saturday October 15, 2016 @01:34PM (#12714854)
That's not quite true. E.g. Google's email spam models are trained without access to the raw text. In general the field of differential privacy is developing rather quickly.
Re:What has happened down here is the winds have changed by ubernostrum on Saturday October 15, 2016 @05:34PM (#12715745)
You need to think of medical privacy the way you think of browser fingerprinting; it's not necessarily any single piece of information that lets you be tracked, but rather the combination of a bunch of them -- even when "anonymized" -- adds up to enough bits to pin a consistent identity on the people involved.

And given what the adtech space has been able to figure out pretty easily in terms of tracking even people who take serious steps to avoid it, you should not think that there is any reasonable amount of "anonymization" that can make otherwise-useful medical details safe to release.

Re:What has happened down here is the winds have changed by vitno on Saturday October 15, 2016 @01:46PM (#12714919)
I'm somewhat confused about how they would be doing that. Do you have any references to blogs/papers on this technique?
Re:What has happened down here is the winds have changed by bjterry on Saturday October 15, 2016 @10:10PM (#12716493)
One typical strategy for spam detection is to convert text to a "bag of words" representation[0]. If you take this bag of words representation and hash all the values, then rather than training words like ED, you are training on word number 19213123. The number of these hashed values is smaller than the number of words, just like a hash table, and this generally doesn't harm the accuracy of the machine learning. When you receive feedback on the classification (from people reporting spam or people marking things as not spam), you just turn the reported email into a bag of hashed words and feed that change into your model.

Because the order of the entries in the bag of words is arbitrary, and the words have been hashed, it is impossible to go back from a bag of words representation to the original email. I don't know if this is what google does, but it is pretty normal to do so.

0: https://en.wikipedia.org/wiki/Bag-of-words_model

Re:What has happened down here is the winds have changed by cvwright on Sunday October 16, 2016 @03:58AM (#12717555)
This is actually a really tricky topic. Things that sound like they should give very good security, often don't in practice. The "hashed bag of words" technique that you describe here sounds an awful lot like some recent attempts at letting legacy systems search on encrypted data [1,2].

We took at look at this recently [3], and it turns out that mapping the word numbers back to the original words is actually a lot more doable than you'd think.

[1] ShadowCrypt: Encrypted Web Applications for Everyone http://dl.acm.org/citation.cfm?doid=2660267.2660326

[2] Mimesis Aegis: A Mimicry Privacy Shield–A System’s Approach to Data Privacy on Public Cloud https://www.usenix.org/conference/usenixsecurity14/technical...

[3] The Shadow Nemesis: Inference Attacks on Efficiently Deployable, Efficiently Searchable Encryption https://www.sigsac.org/ccs/CCS2016/agenda/

Re:What has happened down here is the winds have changed by bjterry on Sunday October 16, 2016 @01:20PM (#12719672)
Yeah, I definitely don't think that this would give you mathematically provable security, especially if you are including n-grams which would allow you to chain together sentences combined with a language model. How much that matters in practice depends on the dimensionality reduction. In the context of google I doubt if this is even much of a specific goal, since no matter what they train on, they actually have access to the source text if they want it.
Re:What has happened down here is the winds have changed by dahart on Saturday October 15, 2016 @07:18PM (#12716065)
Netflix knows your approximate age, gender, and where you live based on your movie likes alone. I suspect the comment you replied to was making the point that Big Data is making privacy impossible. See here for an example: https://datafloq.com/read/re-identifying-anonymous-people-wi...
Re:What has happened down here is the winds have changed by botw on Sunday October 16, 2016 @09:39AM (#12718537)
Don't you remember that crowd-sourced stock predication website that publish the anonymized data and let crowd build model without knowing which specific stock/portfolio is used?
Re:What has happened down here is the winds have changed by nradov on Saturday October 15, 2016 @07:58PM (#12716183)
In the USA the federal government has established clear rules for anonymizing (de-identifying) healthcare data. So it's clearly possible to do so.

http://www.hhs.gov/hipaa/for-professionals/privacy/special-t...

Re:What has happened down here is the winds have changed by Someone on Sunday October 16, 2016 @09:20AM (#12718477)
You can only conclude it is clearly possible from that if you assume the USA federal government is infallible. I don't think that's the case.

The way I read it, the "Safe Harbor" part of that standard allows keeping around part of the zip code if that designates over 20,000 people.

For such a group of just over 20,000, add in birth year and sex (both allowed), and you're down to smallest groups of around 200 people. For the topic at hand (publish the data set so that critics can draw their own conclusions), often general health, education level and race, maybe even line of work (blue collar/white collar/agriculture) must be added, so that critics can check that your sample is representative.

I bet that gets you down to a single person in quite a few of those groups.

Yes, they end with "The covered entity does not have actual knowledge that the information could be used alone or in combination with other information to identify an individual who is a subject of the information.", but the earlier list doesn't make me confident that the USA federal government can make that judgment.

Re:What has happened down here is the winds have changed by jandrese on Saturday October 15, 2016 @08:14PM (#12716220)
It should be pointed out that thanks to the explosion of data anonymizing is a lot harder than you might expect.
Re:What has happened down here is the winds have changed by finid on Saturday October 15, 2016 @03:58PM (#12715435)
Keep in mind that data can always be anonymized. So even most medical or social science research data can be put in a repo.
Re:What has happened down here is the winds have changed by rando832 on Saturday October 15, 2016 @04:12PM (#12715484)
> Keep in mind that data can always be anonymized.

No it can't. Some data can be anonymized, some can't.

Re:What has happened down here is the winds have changed by RyanZAG on Saturday October 15, 2016 @04:19PM (#12715502)
There's always a clever solution to anonymize any data. Post a description of the data and the problems with anonymizing it, and someone out there will always find a clever way to handle it.

You don't have to solve everything yourself. That's the whole point of a peer driven scientific community.

Re:What has happened down here is the winds have changed by dahart on Saturday October 15, 2016 @07:23PM (#12716086)
Inferences in large data sets are more powerful than you think. Individual people have been identified from multiple "anonymized" scrubbed datasets, and its only getting easier as the datasets get bigger and the analytics tech gets better.
Re:What has happened down here is the winds have changed by merraksh on Saturday October 15, 2016 @07:04PM (#12716024)
As said toward the end of the article:

We learn from our mistakes, but only if we recognize that they are mistakes. Debugging is a collaborative process. If you approve some code and I find a bug in it, I’m not an adversary, I’m a collaborator. If you try to paint me as an “adversary” in order to avoid having to correct the bug, that’s your problem.

Re:What has happened down here is the winds have changed by jgalt212 on Saturday October 15, 2016 @11:58AM (#12714413)
> sunlight all of their data and code

This is not always possible. For example, if you are working with proprietary subscription-only datasets where the researcher has no redistribution rights.

Re:What has happened down here is the winds have changed by Cerium on Saturday October 15, 2016 @12:49PM (#12714644)
If the community demands the ability to review code and data then the usage of closed data sets will simply decrease until they comply. We should not base our standards of research on the ease of complying. We should do what we can to produce the most accurate results.
Re:What has happened down here is the winds have changed by nickff on Saturday October 15, 2016 @12:57PM (#12714685)
The problem is not one of convenience, the problem is that you are depriving yourself of huge amounts of valuable (closed) data, and this may cause large gaps in what is researchable.
Re:What has happened down here is the winds have changed by eveningcoffee on Saturday October 15, 2016 @01:46PM (#12714920)
This was the point. You have to pay the price for the principles and hope that the tide turns one day.

If you take your suggested easy route then this day may never come.

Re:What has happened down here is the winds have changed by zmb_ on Saturday October 15, 2016 @04:13PM (#12715485)
Are you a researcher and following those principles? Because it is very easy to demand other people pay the price for what you believe are the right principles.

The reality of the way research funding and academia is set up (at least in Europe) is that the price you pay is likely your career. You can go through all the work and effort to follow those principles, and all that will happen is that the politicians will give the research funding and tenure positions to competitors that published more and told more exciting stories.

Academia and research will necessarily reflect the incentives put in place by the people with the money (i.e., politicians). And right now they are giving money for exciting stories and publication counts. That is where the change must start.

Re:What has happened down here is the winds have changed by eveningcoffee on Sunday October 16, 2016 @02:17PM (#12720030)
I did not demand anything. I just explained that when everybody complies, nothing will probably change.
Re:What has happened down here is the winds have changed by nickff on Saturday October 15, 2016 @01:53PM (#12714951)
My point is that there are large fields where we may not get access to open source data in the foreseeable future; in the meantime, we are depriving ourselves of potentially useful or valuable knowledge. Imagine if you could reduce the number of traffic deaths by analyzing a closed data set from Lyft or Uber; is this worth doing, or should we just tell the PhD candidate not to bother?
Re:What has happened down here is the winds have changed by unimpressive on Saturday October 15, 2016 @01:06PM (#12714720)
The problem is that a lot of studies don't suffer from this problem, and their data/code isn't open either. What we're looking at is a default-closed mindset, which needs to be inverted ASAP if these people want us to trust them in any significant capacity.
Re:What has happened down here is the winds have changed by mcguire on Saturday October 15, 2016 @12:56PM (#12714682)
And such data sets should be trusted...why?
Re:What has happened down here is the winds have changed by WalterSear on Saturday October 15, 2016 @12:40PM (#12714587)
Not directly relevant to the more widespread issue of how people should provide and react to criticism of scienctific work.
Re:What has happened down here is the winds have changed by rwallace on Saturday October 15, 2016 @12:49PM (#12714646)
Then it should be required whenever and to the extent it is possible. And where it is not possible, we should be considerably more skeptical of claims made, because trusting a claim based on a proprietary dataset requires a hefty dollop of faith.
Re:What has happened down here is the winds have changed by Mendenhall on Saturday October 15, 2016 @05:38PM (#12715762)
I agree, its like saying "I have proof I just cant show you".
Re:What has happened down here is the winds have changed by ArkyBeagle on Saturday October 15, 2016 @03:33PM (#12715338)
Then the provider of the subscription must be able to vouch for it or that data should not be used. The provider should also be .... sensitive to the need for that data to be used well, for any conclusion drawn from it to be reproducible.
Re:What has happened down here is the winds have changed by lstamour on Saturday October 15, 2016 @12:44PM (#12714618)
Presumably however other researchers could subscribe to the same source... third-party proprietary datasets, if non-partisan wrt research results, are still better than first-party proprietary datasets, right?
Re:What has happened down here is the winds have changed by krapp on Saturday October 15, 2016 @04:25PM (#12715523)
It's possible, it's just not legal.

Someone could set up a Wikileaks type site for scientific and medical datasets and then what the law says becomes irrelevant.

Re:What has happened down here is the winds have changed by hackuser on Saturday October 15, 2016 @12:39PM (#12714581)
> Good scientists should welcome this challenge with open arms

They should welcome online trolling, abuse, and personal attacks? That is what Fiske criticizes in her article, not serious criticism and debate, which she explicitly welcomes and encourages.

Re:What has happened down here is the winds have changed by unimpressive on Saturday October 15, 2016 @12:47PM (#12714627)
Fiske is pulling a classic Motte and Bailey strategy.

http://slatestarcodex.com/2014/07/07/social-justice-and-word...

The Motte is that we should condemn personal attacks, trolling, and abuse. This is completely uncontroversial and nobody sane would disagree.

The Bailey is that criticism made outside of the peer review process is somehow terrorism, which is so ludicrous that ones reaction should involve spirited laughter.

Re:What has happened down here is the winds have changed by nickpsecurity on Saturday October 15, 2016 @08:41PM (#12716287)
That was a great read. Illustrated the problems really well. I thought the antibiotic thing was hilarious. Still need more condensed posts to drop on anyone skeptical about the SJW effect happening where lines are drawn in prejudicial ways with words that are used as weapons. Many people might not go through such a long piece.
Re:What has happened down here is the winds have changed by conistonwater on Saturday October 15, 2016 @01:38PM (#12714884)
I think you are missing the point of both the blog post and Fiske's own article. What she labels as "personal attacks" was, in fact, legitimate scientific criticism, and she tries to dismiss it based on it not being published according to the right norms (according to her). She's trying to bring accusations of trolling and abuse, and you are taking her word for it as if that is the right description of what has been happening so far. She doesn't "explicitly welcome" serious criticism, because criticism published in scientific journals is rather seriously flawed and ineffective (too slow, too strong an incentive to be biased in favour of already published papers: see, for example, the discussions and failed replications that arose from Bem's ESP paper, that was really terrible). This is consistent with her comment about "methodological terrorism", which is as wrong-headed as can be, and I think clear evidence that it's not about "online abuse" in the usual sense.

If you read Gelman's posts (going back quite a while), for example, you'll see that the criticism that Fiske dismisses as trolling and abuse is nothing of the sort, and being published on a blog does not make it less valid.

In the end, it is part of the culture of science and part of being a good scientist that one should be willing to accept criticism, and maybe refutations, of one's own work, so trying to get above it by claiming "personal attacks" is seriously bad form.

P.S. There was another example of this kind of an "attack" when somebody wrote a bot for finding statistics errors: https://news.ycombinator.com/item?id=12643978

Re:What has happened down here is the winds have changed by mafribe on Saturday October 15, 2016 @01:24PM (#12714807)

   They should welcome online trolling, 
   abuse, and personal attacks?
Nobody should welcome it, but -- as it comes with the territory -- they need to ignore it.

She works on what is historically and cross-culturally arguably the most controversial subject, namely human sexuality. Attacks are to be expected, and the mature reaction to this is to lead by example: ignore the attacks and be as meticulously scientific as possible in the hope of inspiring others to be similarly mature. All the more so if you work in a field (psychology) that has a long history of unsupported claims and lack of methodological rigour.

The reason science works, the reason we can fly to Mars, have a supercomputer in everybody's pocket today, can treat many diseases, is because sufficiently many adhere to a rigorous scientific methodology and every scientist is extremely critical of colleagues who don't. It is incumbent upon all scientists to hold themselves and others up to the highest standards.

Computer science grew out of worries about the lack of rigor in the foundations of mathematics,triggered by the (re-)discovery of non-Euclidian geometry. Mathematics, the most rigorous of all scientific fields, is currently beginning to move towards formally verified proofs. To be even more reliable.

Re:What has happened down here is the winds have changed by hackuser on Saturday October 15, 2016 @03:09PM (#12715245)
> it comes with the territory

I disagree; that's an excuse for abusive, unproductive behavior. In many environments, people manage to criticize ideas respectfully and productively, even on social forums like HN. Abuse is counter-productive and completely unnecessary.

Re:What has happened down here is the winds have changed by mafribe on Saturday October 15, 2016 @03:28PM (#12715319)

   I disagree;
What do you disagree with? The factual claim?

It's not relevant that some manage to discuss sexuality respectfully and productively. Most can't, as of October 2016.

Claims of scientific misconduct (in a general sense) ought to be taken seriously by scientists. There is nothing else to say.

What alternative do you suggest? Somebody said mean things on Twitter, hence psychologists like Fiske should continue as before?

Re:What has happened down here is the winds have changed by hackuser on Saturday October 15, 2016 @06:47PM (#12715964)
> Claims of scientific misconduct (in a general sense) ought to be taken seriously by scientists.

I disagree. Not all claims should be taken seriously; most should be ignored. Claims accompanied by abuse seriously and rightly damage their own credibility; if I see abuse anywhere, I just stop reading and move on.

There are not nearly enough resources to address every random person's claim about every issue in the world. People don't read every book and website, address every conspiracy theory, or give time to every crackpot or amateur who wants to have a say. Google doesn't listen to every users' ideas about their software; the military doesn't listen to everyone's strategic recommendations; physicists don't listen to every person's theory of thermodynamics; the pilots of your airplane don't want your input on how to do their jobs. I have no interest in random people's ideas about IT; they have no idea what they are talking about.

You need to demonstrate that you are worth their time by establishing credibility. It seems silly that because people have access to a platform that amplifies their voices, they think professionals will want to hear from them.

Re:What has happened down here is the winds have changed by Kalium on Sunday October 16, 2016 @12:19AM (#12716874)
When reasonable criticism by highly qualified statisticians is dismissed as terrorism, perhaps it is possible that abusive behavior by critics is not the issue at hand.
Re:What has happened down here is the winds have changed by wyager on Saturday October 15, 2016 @01:14PM (#12714744)
Have you seen what passes for "online abuse" right now? The fact that Fisk earnestly uses the phrase "methodological terrorism" suggests that she is not to be trusted with negative connotations.

Everyone agrees "abuse" (connotation: wife beating) is bad, so people like Fisk just redefine "abuse" to mean "being blunt online", and people who aren't inoculated against semantic overloading techniques fall for it.