News for hackers. Stuff that matters.
Re:FDA Warning Letter to 23andMe by crusso on Monday November 25, 2013 @10:54AM (#6794708)
23andMe offers a very low cost way to open the door to a whole new world of having people understand something about their genetic makeup and the possible impact upon their lives.

The work that they're doing to show how genetic features correlate with the observed tastes, behaviors, and propensities of users of the site seems remarkably useful.

The FDA is doing exactly what it always does, stifling innovation while justifying its existence using the voluminous laws created by politicians justifying their existences.

If the FDA were useful, it would be helping 23andMe rather than trying to take them down.

Re:FDA Warning Letter to 23andMe by icegreentea on Monday November 25, 2013 @11:07AM (#6794823)
How the hell should the FDA be trying to help 23andMe?

Did you even read the letter? The FDA is making serious and legitimate claims. Amongst other things, the FDA is claiming that 23andMe has said that they were in the process of completing their validation studies. 23andMe has already submitted their 510(k) (which is the form/clearance required for -any- medical device), but failed to provide the required evidence to back up their claims in their submission.

Note that the FDA is that claiming that 23andMe has not provided sufficient evidence (as in they don't like the study you did) rather the FDA is claiming that 23andMe has not submitted the required evidence at all. As in there should be this big ass binder full of test results comparing 23andMe's test results against the ground truth, but that binder doesn't exist.

This is hardly stifling innovation. 23andMe has had 5 years since they started selling their product to produce an analytical or clinical study proving their product's effectiveness, and they failed to do so, despite clearly knowing that it was required, to the point of claiming that they were in fact working on it.

Re:FDA Warning Letter to 23andMe by dnautics on Monday November 25, 2013 @11:10AM (#6794854)
5 years for a clinical study? That's a laughably short amount of time. You don't just write a test suite and get your answer out. Moreover, this is kind of uncharted territory: If you've got a device that, say, estimates an 'elevated' risk of alzheimer's in 20 year olds, how long of a clinical trial period do you suspect would be reasonable to run the test?
Re:FDA Warning Letter to 23andMe by icegreentea on Monday November 25, 2013 @11:29AM (#6795016)
5 years for an analytical/clinical study for a DNA test? Absolutely in the cards. 23andMe isn't discovering new mutations that it then claims are linked to some phenotypical difference. They are going through all the SNPs that have ever been studied by someone else, testing you for it, and then telling you that "You have this SNP which is linked to clopidogrel metabolism" for example.

The study that the FDA would have required from 23andMe is to show that the genetic testing provides the correct results at the bare minimal. They would require 23andMe to quantify their actual error rate of their product in use by customers. Depending on 23andMe's claims in their 510(k) submission regarding their intended uses, then the burden of proof may go higher.

The point is that if 23andMe can't actually prove that this test result predicts elevated risk of Alzheimer's (either by their own study, or through other relevant studies) then they sure as hell shouldn't say that their test predicts Alzheimer's risk.

Case in point, clopidogrel response. The link between CYP2C19 and clopidogrel response is well studied. There are already other tests on the market based on this relationship. Given this, 23andMe would not have to prove by themselves that clopidogrel and CYP2C19 are linked, they would merely have to prove their their CYP2C19 test provided correct results.

Re:FDA Warning Letter to 23andMe by dnautics on Monday November 25, 2013 @11:34AM (#6795052)
Case in point, clopidogrel response. The link between CYP2C19 and clopidogrel response is well studied. There are already other tests on the market based on this relationship. Given this, 23andMe would not have to prove by themselves that clopidogrel and CYP2C19 are linked, they would merely have to prove their their CYP2C19 test provided correct results.

It's not entirely clear to me that this is what the FDA is demanding. Quantifying the lab error rate is easy, and while it's possible that 23andMe is failing to do so, it's almost like not doing that would take effort.

Re:FDA Warning Letter to 23andMe by icegreentea on Monday November 25, 2013 @11:45AM (#6795130)
Having worked at a company that went through the FDA process for a genetic test product, where the link between gene in question and phenotype were fairly well characterized, what we want to do for our analytical studies were to basically push the tests out to their failure modes. That meant seeing what happened with common contaminants, what happens with incorrect sample collection technique, what happens with incorrect storage, etc. For our clinical tests, we had to prove not the lab rate, but the actual customer use rate.

For example, 23andme ships you a test package, you sample it yourself, send it back and then they process it. While quantifying that last rate is simple (as you say), it's crucial to understand how well the product will work in practice, with an actual customer on the other end.

For something like 23andme, that would likely mean getting a whole bunch of untrained test subjects, having them preform the sample collection as instructed by the instructions shipped with the sample collector, having them shipped over by standard means to the lab, and then processed. The test subjects would likely then have to have their DNA fully sequenced with some gold standard test, and then the results compared. 23andMe would be given leeway, in the sense that inconclusives don't "really" count as a wrong result.

Re:FDA Warning Letter to 23andMe by dnautics on Monday November 25, 2013 @02:43PM (#6796410)
Since the field is new, it is not clear to me that the FDA has a set standard procedure to determine one thing or another, so it is possible that the FDA is requiring a higher level of review that may or may not be equivalent to what you experienced. It is also possible that 23andMe is being totally negligent.
Re:FDA Warning Letter to 23andMe by RogerL on Monday November 25, 2013 @06:33PM (#6797873)
You are not allowed to just make things up. How do they know there is an elevated risk if they have not studied it? This is pretty basic science. I think you are probably suggesting a hypothesis, as in a bunch of 60 yo patients with Alzheimer's has this genetic marker, you at 20 have this same genetic marker, therefore you may be at elevated risk. That seems like a reasonable hypothesis, but that is all it is until tested. Until then, you don't get to make claims.
Re:FDA Warning Letter to 23andMe by pilom on Monday November 25, 2013 @10:58AM (#6794743)
No the FDA is saying that they need to see proof that the test has a high level of accuracy and isn't just snake oil. 23andMe tried saying "you shouldn't actually use our test for diagnosing disease" to which the FDA said "then stop marketing it that way."

23andMe both wants to _say_ they have a totally accurate test, but doesn't want to pay to do the testing to prove it is totally accurate. The FDA is saying you can't have it both ways.

Re:FDA Warning Letter to 23andMe by dnautics on Monday November 25, 2013 @11:16AM (#6794912)
have you actually used 23andMe? All over the place, it says, the information is based on academic studies, these figures are only n star (on a rating from 1-5) reliable, it only is conclusive for ethnicities X, etc, etc, etc. Now, it is not clear to me that people read all that (in the aldehyde dehydrogenase test, a lot of caucasians don't realize that it only applies to asians, even though it says that in bold, font right underneath the title). There is no such thing as a totally accurate test and I don't think 23andMe says that anywhere.
Re:FDA Warning Letter to 23andMe by summerdown2 on Monday November 25, 2013 @01:32PM (#6795882)
I'm not sure total accuracy is the point. Rather, I think it's about the claimed value being correct. If 23andMe say a test has a 20% accuracy, they should be able to prove how they came by that number.

There's a big difference between telling someone they have a 5% chance of something and telling them they have a 25% chance of something - even though both are uncertain.

Re:FDA Warning Letter to 23andMe by pilom on Monday November 25, 2013 @06:17PM (#6797790)
The issue isn't them saying "you have a higher likelyhood of disease." The problem the FDA has is 23andMe saying "you have the gene variation XYZ." If you take your 23andMe results to a doctor, the doctor should at best order a REAL FDA approved diagnostic test to see if you really do have variation XYZ because 23andMe hasn't proven that their test is accurate.
Re:FDA Warning Letter to 23andMe by rayiner on Monday November 25, 2013 @10:58AM (#6794741)
> The work that they're doing to show how genetic features correlate with the observed tastes, behaviors, and propensities of users of the site seems remarkably useful.

Oh man are you going to be upset when we regulate all that out of existence. Trying to correlate genetics to tastes, behaviors, and propensities, while scientifically interesting, is a total political non-starter.

> The FDA is doing exactly what it always does, stifling innovation while justifying its existence using the voluminous laws created by politicians justifying their existences.

This action is the FDA acting within the core of its jurisdiction, and within the core of a law that was passed with tremendous public support. This is not to say that agencies don't do what you're describing, but in this case, it's pretty much the FDA's job to control this sort of "innovation."

Re:FDA Warning Letter to 23andMe by crusso on Monday November 25, 2013 @11:13AM (#6794890)
Oh man are you going to be upset when we regulate all that out of existence

I guess you're being sarcastic, but it's not that I fear progress will stop. What I see instead is a great deal of needless friction that prevents efficiency. When you consider how innovations and businesses build on one another over the years - any friction in the process compounds the amount of time for "the future" to be here.

I doubt anyone here on HN doesn't realize that in the future our genetic code will be understood and manipulated like we do with computers and software today. Will this golden age of genetic self determination be 50 years from now or 500 years from now?

Roadblocks we put in front of progress now will mean many decades of delay for the advances down the road that are dependent upon today's advances and the intervening thousands of others.

law that was passed with tremendous public support

Doesn't at all make it right, good, or mean I won't bitch about it.

Re:FDA Warning Letter to 23andMe by rayiner on Monday November 25, 2013 @11:19AM (#6794938)
> I guess you're being sarcastic, but it's not that I fear progress will stop.

I'm not being sarcastic. Any technology that tries to correlate genetic markers with behavioral characteristics will be regulated out of existence. I'm not taking a position one way or the other as to whether this is a good idea, but I'd bet money on it being the outcome.

> Doesn't at all make it right, good, or mean I won't bitch about it.

Sure. But what it does mean is that it's an intended consequence, rather than an unintended consequence as your characterization suggested.

Re:FDA Warning Letter to 23andMe by crusso on Monday November 25, 2013 @11:35AM (#6795053)
Any technology that tries to correlate genetic markers with behavioral characteristics will be regulated out of existence

I'm sure that there are those who would like to make all such pursuits illegal. Such a slippery slope, though. Where will that line be drawn? Which 23AM style correlation question should be illegal for inclusion in their correlation determination system?

  1. Do brussel sprouts taste bitter and unpleasant?
  2. Are you more active in the mornings?
  3. Do you prefer blondes to brunettes?
  4. Do you carry debt on your credit cards month-to-month or pay them off?
  5. Did you graduate college?
  6. Do your joints ache after rigorous exercise?
  7. Have you ever been arrested for a felony?
  8. Are people with a great deal of money more lucky than clever?
  9. Does hard work tend to lead to financial success?
Re:FDA Warning Letter to 23andMe by rayiner on Monday November 25, 2013 @11:50AM (#6795166)
4, 5, and 7, obviously.
Re:FDA Warning Letter to 23andMe by marris on Monday November 25, 2013 @03:08PM (#6796576)
not obvious
Re:FDA Warning Letter to 23andMe by Intermernet on Monday November 25, 2013 @09:20PM (#6798665)
Fairly obvious: 4, 5 & 7 request factual answers. The rest are asking for opinions.
Re:FDA Warning Letter to 23andMe by nickff on Tuesday November 26, 2013 @01:53AM (#6799591)
Strictly speaking, the others are not opinions, they are subjective.
Re:FDA Warning Letter to 23andMe by anigbrowl on Monday November 25, 2013 @11:27AM (#6795000)
any friction in the process compounds the amount of time for "the future" to be here

You're one of those people that rides bicycles without any brakes then, I take it.

Re:FDA Warning Letter to 23andMe by crusso on Monday November 25, 2013 @11:56AM (#6795198)
You're one of those people who sees "needless friction" in the previous sentence and tries to make an out-of-context argument against a position that I obviously don't hold.
Re:FDA Warning Letter to 23andMe by tptacek on Monday November 25, 2013 @12:16PM (#6795336)
It's hard to tell what position you hold, since the kernel of your argument seems to be that 23AM is a low-cost democratizing alternative to existing licensed medical technology, and should therefore be free to market itself without FDA approval. Do you also believe that of the companies who sell apricot pits as a cancer cure? I doubt it, but the logic you use sustains both arguments.
Re:FDA Warning Letter to 23andMe by crusso on Monday November 25, 2013 @12:25PM (#6795394)
Where oh where did I say anything about "alternative to existing licensed medical technology"? Where has 23AM indicated such a thing whereby I'm supporting that argument by proxy?

Where did I or 23AM indicate that they had a cure for anything whatsoever?

The answers are "nowhere", "nowhere", and "nowhere".

Re:FDA Warning Letter to 23andMe by anigbrowl on Monday November 25, 2013 @12:45PM (#6795546)
https://www.23andme.com/store/cart/ explicitly claims the test can help you manage your health.
Re:FDA Warning Letter to 23andMe by crusso on Monday November 25, 2013 @12:57PM (#6795621)
And when the word "help" means "instead of", I'll think you might have a point... but it doesn't so you don't.
Re:FDA Warning Letter to 23andMe by anigbrowl on Monday November 25, 2013 @02:06PM (#6796154)
I do have a point, because it's possible for one factor among several to weight someone's choice. However, you're nitpicking at my paraphrase, while ignoring the content at the link which I supplied (which was why I supplied it.

The specific claim made by 23andme, without disclaimers, is: 23andMe empowers you to better manage your health and wellness. This seems to me like a straightforward claim of diagnostic value; the fact that it's non-exclusive is beside the point.

Re:FDA Warning Letter to 23andMe by Dylan16807 on Monday November 25, 2013 @03:41PM (#6796819)
I think whether it's exclusive is a very large part of the point.
Re:FDA Warning Letter to 23andMe by anigbrowl on Monday November 25, 2013 @04:20PM (#6797128)
I disagree. certainly, the risk of misdiagnosis is is inverse proportion to the degree of supplementarity, but that can still affect an awful lot of people and result in significant economic loss. It seems to me that some people want to argue this on a binary basis, ie since 23andme does not purport to replace the advice of a primary physician, its liability for misdiagnosis therefore should fall to zero. To me, though, it seems quite likely that if 23andme suggests a risk factor that is greater than the probability spread between different options offered by a patient's physician(s), then it's very likely that the 23andme data will be given excess weight given the notoriously poor grasp of Bayesian inference among the general population (and even among some groups of clinicians).

If anything, the supplementary nature of 23andme's test data should make compliance easier, since their burden will drop proportionately under the B<PL formula employed to assess tort liability in the US. http://en.wikipedia.org/wiki/Calculus_of_negligence

I wonder if you and other folks who seem to be espousing this binary approach live in or hail from states with contributory negligence regimes.

Re:FDA Warning Letter to 23andMe by tptacek on Monday November 25, 2013 @01:14PM (#6795741)
For whatever it's worth for you to know, it would have been easy to make that same point without being nasty about it, and I think the nastiness harms your argument. "But it doesn't so you don't" makes one sound like an angry teenager; it's a wordier way of saying "so there!". You don't see a lot of adults tacking "so there!" onto the ends of their arguments, because it's a self-evidently silly thing to add.
Re:FDA Warning Letter to 23andMe by tptacek on Monday November 25, 2013 @12:27PM (#6795409)
This is disingenuous. The FDA doesn't claim 23AM markets a "cure" either.
Re:FDA Warning Letter to 23andMe by crusso on Monday November 25, 2013 @12:55PM (#6795607)
Nobody said anything about a cure until you brought up apricot pits as being analogous.
Re:FDA Warning Letter to 23andMe by tptacek on Monday November 25, 2013 @01:02PM (#6795657)
So your position is that the FDA should not have the power to regulate diagnostic tests. I think I understand now.
Re:FDA Warning Letter to 23andMe by crusso on Monday November 25, 2013 @03:42PM (#6796834)
My position is that the FDA should have better things to do with its limited budget that never seems enough to keep up with the drug and treatment approval process than to go after innovative companies like 23AM.
Re:FDA Warning Letter to 23andMe by chrisoverzero on Monday November 25, 2013 @06:52PM (#6797998)
And if only a few people die, then no big deal, right?
Re:FDA Warning Letter to 23andMe by crusso on Monday November 25, 2013 @07:08PM (#6798084)
As though lives are more likely to be lost because 23andMe is putting more information out there than are going to be lost because of all the years behind we would be without extra information.

Take down the giants upon whose shoulders we could be standing upon and be happy that no one is so tall that they can fall and hurt someone.

Re:FDA Warning Letter to 23andMe by douglee650 on Monday November 25, 2013 @11:32AM (#6795037)
there have definitely been, uh, attempts at eugenics in the past. less sophisticated, overt attempts, but you can not remove the smell of certain things, no matter the scientific veneer pasted over them.
Re:FDA Warning Letter to 23andMe by masklinn on Monday November 25, 2013 @11:09AM (#6794851)
> while scientifically interesting

I'm not sure "interesting" is the word I'd have used. "Unlikely" is probably much, much closer to the truth. It's more or less astrology.

Re:FDA Warning Letter to 23andMe by crusso on Monday November 25, 2013 @11:18AM (#6794926)
Correlating genetics to propensities is astrology?

So, correlating the existence of certain genes to propensity of heart disease is mumbo jumbo?

Not really sure why anyone would say such a thing. Maybe you didn't understand what the word "propensities" means?

Re:FDA Warning Letter to 23andMe by anigbrowl on Monday November 25, 2013 @11:40AM (#6795087)
When you put it in the same sentence as 'tastes and behaviors' you're creating a very different context from things like heart disease. Imagine, for example, a genetic test that says that you, Crusso, are 29% more likely to commit a criminal act involving deception than the median person. Now imagine that your genetic testing service has a data breach and suddenly you have immense difficulty getting hired, getting credit, or getting a table in a restaurant.

One has only to glance back to the last century to see overconfident claims along the same lines from eugenicists, for example. Or look at the dreadful state of science journalism and the broken logic that prevails in many internet comment/forum sections to see how easily a statistical correlation can be substituted for fact - to say nothing of poor statistical work in scientific research, where publication strongly favors positive results and replication is often under-prioritized.

Now please return to your preventive custody zone, non-citizen.

Re:FDA Warning Letter to 23andMe by crusso on Monday November 25, 2013 @12:18PM (#6795351)
statistical correlation can be substituted for fact

Well let's stop this Science nonsense and get on with full blown Political Correctness as our guide to the future we're heading toward.

Re:FDA Warning Letter to 23andMe by masklinn on Monday November 25, 2013 @01:50PM (#6796029)
That's got nothing to do with PC or any such nonsense, it's got to do with you taking as your starting point that it's possible to reduce highly complex, multivariate and environmentally influenced phenotypes down to useful genotypes.

Your comments are essentially daily mail fare.

Re:FDA Warning Letter to 23andMe by Dylan16807 on Monday November 25, 2013 @03:47PM (#6796862)
anigbrowl's comment argued that correlations were bad, and did not mention whether useful ones were possible. Blame them for bringing up political correctness, not crusso.
Re:FDA Warning Letter to 23andMe by anigbrowl on Monday November 25, 2013 @03:55PM (#6796932)
This is news to me.
Re:FDA Warning Letter to 23andMe by Dylan16807 on Monday November 25, 2013 @04:08PM (#6797021)
Would you care to provide your interpretation of "Now imagine that your genetic testing service has a data breach and suddenly you have immense difficulty getting hired, getting credit, or getting a table in a restaurant."
Re:FDA Warning Letter to 23andMe by anigbrowl on Monday November 25, 2013 @04:56PM (#6797355)
The meaning of that is self-evident - you could be discriminated against because people considered you to be untrustworthy due to the results of the test mentioned in the preceding sentence. Where you and crusso see political correctness - perhaps in the belief that I'm describing such a test as a proxy for some identity group - what I'm actually concerned about is the accuracy and/orpredictive power of such tests. I really doubt that you would be OK with finding yourself on the receiving end of such an evaluation.
Re:FDA Warning Letter to 23andMe by Dylan16807 on Monday November 25, 2013 @05:33PM (#6797573)
I see arguing against the test because of possible discriminatory uses as an argument of political correctness. Maybe we have different definitions.
Re:FDA Warning Letter to 23andMe by eruditely on Monday November 25, 2013 @09:21PM (#6798668)
Obviously you're just dragging your feet here. He is not saying whether the discrimination itself is correct, but that if the validity of the tests is not correct this can lead to incorrect discrimination here, the chance of this data ruining someones life in the wrong hands is very high.
Re:FDA Warning Letter to 23andMe by Dylan16807 on Tuesday November 26, 2013 @11:46AM (#6802417)
Avoiding performing measurements because you're worried about how the results could possibly be misused is a political motivation, not a scientific one.

I'm just trying to argue in favor of this comment https://news.ycombinator.com/item?id=6794926 , not about whether doing the testing is a spectacularly good idea.

Re:FDA Warning Letter to 23andMe by eruditely on Friday November 29, 2013 @02:00PM (#6820559)
The primary concern is fragility, not in truth-space. Scientists have ethical responsibilities and pretending that this isn't true is probably how NSA mathematicians justify their work.
Re:FDA Warning Letter to 23andMe by HarryHirsch on Monday November 25, 2013 @11:02AM (#6794779)
If the FDA were useful, it would be helping 23andMe rather than trying to take them down.

It's not their mandate to help 23andme, their mandate is to protect the general public. Their enforcement letter clearly spells it out: the FDA had had concerns about the validity of some of their tests, and they gave 23andme opportunity to address there. Since they failed, the FDA is taking action.

Re:FDA Warning Letter to 23andMe by nickff on Tuesday November 26, 2013 @01:58AM (#6799610)
The FDA protects the public, but only from new things, it does not protect new from a disease, but it does protect you from a potentially unproductive test or treatment. One could say the FDA exists to ensure that all statistical errors are of type II.

http://en.wikipedia.org/wiki/Type_I_and_type_II_errors

Re:FDA Warning Letter to 23andMe by dragonwriter on Monday November 25, 2013 @01:15PM (#6795750)
> If the FDA were useful, it would be helping 23andMe rather than trying to take them down.

If the FDA were trying to take 23andMe down rather than helping them, they wouldn't have been working with them for several years to get them into compliance and only issued a Warning Letter after 23andMe walked away from the process.

Re:FDA Warning Letter to 23andMe by HeyLaughingBoy on Monday November 25, 2013 @08:21PM (#6798424)
Exactly. The FDA takes this shit seriously and will order you to take products off the market or shut you down completely if you fail to comply with their orders. Abbot famously ran afoul of this 10 years ago and it looks like they're having trouble again. http://www.mddionline.com/node/5701
Re:FDA Warning Letter to 23andMe by DanBC on Monday November 25, 2013 @11:03AM (#6794794)
> If the FDA were useful, it would be helping 23andMe rather than trying to take them down.

FDA has tried to help 23andme. 23andme declined the help.

Re:FDA Warning Letter to 23andMe by metaphorm on Monday November 25, 2013 @11:04AM (#6794800)
let me guess, you're an investor in 23andMe?